[lxc-users] lxc move fails

[Tomasz Chmielewski]

Trying to move a running container between two Ubuntu 16.04 servers with
the latest updates installed:

# lxc move local-container remote:
error: Error transferring container data: checkpoint failed:
(00.316028) Error (pie-util-vdso.c:155): vdso: Not all dynamic entries
are present
(00.316211) Error (cr-dump.c:1600): Dumping FAILED.


Expected?


Tomasz Chmielewski
http://wpkg.org

[Stéphane Graber]

Trying to move a running container between two Ubuntu 16.04 servers with the
(00.316028) Error (pie-util-vdso.c:155): vdso: Not all dynamic entries are
present
(00.316211) Error (cr-dump.c:1600): Dumping FAILED.
Expected?

I don't believe I've seen that one before. Maybe Tycho has.

Live migration is considered an experimental feature of LXD right now,
mostly because CRIU still needs quite a bit of work to serialize all
useful kernel structures.

You may want to follow the "Sending bug reports" section of my post here
https://www.stgraber.org/2016/04/25/lxd-2-0-live-migration-912/

That way we should have all the needed data to look into this.

[Tomasz Chmielewski]

Post by Stéphane Graber

Post by Tomasz Chmielewski
Expected?

I don't believe I've seen that one before. Maybe Tycho has.
Live migration is considered an experimental feature of LXD right now,
mostly because CRIU still needs quite a bit of work to serialize all
useful kernel structures.
You may want to follow the "Sending bug reports" section of my post here
https://www.stgraber.org/2016/04/25/lxd-2-0-live-migration-912/
That way we should have all the needed data to look into this.

FYI I'm using Linux 4.6.0 (from
http://kernel.ubuntu.com/~kernel-ppa/mainline/) on both servers, as all
earlier kernels are not stable with btrfs.

Could be it's not compatible?

Do you still want me to report the issue?


Tomasz Chmielewski
http://wpkg.org

[Tycho Andersen]

Post by Tomasz Chmielewski

Post by Stéphane Graber

Post by Tomasz Chmielewski
Expected?

I don't believe I've seen that one before. Maybe Tycho has.
Live migration is considered an experimental feature of LXD right now,
mostly because CRIU still needs quite a bit of work to serialize all
useful kernel structures.
You may want to follow the "Sending bug reports" section of my post here
https://www.stgraber.org/2016/04/25/lxd-2-0-live-migration-912/
That way we should have all the needed data to look into this.

FYI I'm using Linux 4.6.0 (from
http://kernel.ubuntu.com/~kernel-ppa/mainline/) on both servers, as all
earlier kernels are not stable with btrfs.
Could be it's not compatible?
Do you still want me to report the issue?

Yes, an issue report would be appreciated. Can you include the full
log? Looks like your container is using some program with some sort of
funny ELF headers that criu doesn't quite understand.

Thanks,

Tycho

Post by Tomasz Chmielewski
Tomasz Chmielewski
http://wpkg.org
_______________________________________________
lxc-users mailing list
http://lists.linuxcontainers.org/listinfo/lxc-users

[Tomasz Chmielewski]

Post by Tycho Andersen
Yes, an issue report would be appreciated. Can you include the full
log?

Reported here:

https://bugs.launchpad.net/ubuntu/+source/criu/+bug/1588133

If you need more info, let me know.

Post by Tycho Andersen
Looks like your container is using some program with some sort of
funny ELF headers that criu doesn't quite understand.

This is pretty much standard Ubuntu 16.04. The only running binary which
is out of repositories is nginx (from upstream nginx repo).


Tomasz Chmielewski
http://wpkg.org

[Stéphane Graber]

Post by Tomasz Chmielewski

Post by Stéphane Graber

Post by Tomasz Chmielewski
Expected?

I don't believe I've seen that one before. Maybe Tycho has.
Live migration is considered an experimental feature of LXD right now,
mostly because CRIU still needs quite a bit of work to serialize all
useful kernel structures.
You may want to follow the "Sending bug reports" section of my post here
https://www.stgraber.org/2016/04/25/lxd-2-0-live-migration-912/
That way we should have all the needed data to look into this.

FYI I'm using Linux 4.6.0 (from
http://kernel.ubuntu.com/~kernel-ppa/mainline/) on both servers, as all
earlier kernels are not stable with btrfs.
Could be it's not compatible?
Do you still want me to report the issue?
Tomasz Chmielewski
http://wpkg.org

Probably still worth reporting it. It's obviously not a kernel that we
support but it may show new CRIU incompatibilities that we'll soon have
to deal with (I'm expecting Ubuntu 16.10 to ship with 4.6 or higher).

[jjs - mainphrame]

I've been hoping for a return of live migration functionality as well.
I tried after today's lxc upgrades, but no joy:

***@olympia:~# lxc move kangal lxd1:
error: Error transferring container data: checkpoint failed:
(00.614250) Error (files-reg.c:683): Can't dump ghost file
/lib/x86_64-linux-gnu/libc-2.19.so of 1840928 size, increase limit
(00.614252) Error (cr-dump.c:1356): Dump mappings (pid: 3572) failed with -1
(00.617439) Error (cr-dump.c:1600): Dumping FAILED.
***@olympia:~#

Both hosts are ubuntu 16.04, up to date as of this message.

Shall I file a bug report?

Jake

Post by Stéphane Graber

Trying to move a running container between two Ubuntu 16.04 servers with the
(00.316028) Error (pie-util-vdso.c:155): vdso: Not all dynamic entries are
present
(00.316211) Error (cr-dump.c:1600): Dumping FAILED.
Expected?

I don't believe I've seen that one before. Maybe Tycho has.
Live migration is considered an experimental feature of LXD right now,
mostly because CRIU still needs quite a bit of work to serialize all
useful kernel structures.
You may want to follow the "Sending bug reports" section of my post here
https://www.stgraber.org/2016/04/25/lxd-2-0-live-migration-912/
That way we should have all the needed data to look into this.
--
Stéphane Graber
Ubuntu developer
http://www.ubuntu.com
_______________________________________________
lxc-users mailing list
http://lists.linuxcontainers.org/listinfo/lxc-users

[Tycho Andersen]

Post by jjs - mainphrame
I've been hoping for a return of live migration functionality as well.
(00.614250) Error (files-reg.c:683): Can't dump ghost file
/lib/x86_64-linux-gnu/libc-2.19.so of 1840928 size, increase limit
(00.614252) Error (cr-dump.c:1356): Dump mappings (pid: 3572) failed with -1
(00.617439) Error (cr-dump.c:1600): Dumping FAILED.
Both hosts are ubuntu 16.04, up to date as of this message.
Shall I file a bug report?

Sure, we should probably expose some way to increase the ghost file
size limit. I'm not sure if we can make it unlimited, though, so there
will always be some problem like this. Of course, 640k should be
enough for anyone and all that :)

But yes, please file a bug and we can at least make it configurable.

Tycho

Post by jjs - mainphrame
Jake

Post by Stéphane Graber

Trying to move a running container between two Ubuntu 16.04 servers with the
(00.316028) Error (pie-util-vdso.c:155): vdso: Not all dynamic entries are
present
(00.316211) Error (cr-dump.c:1600): Dumping FAILED.
Expected?

I don't believe I've seen that one before. Maybe Tycho has.
Live migration is considered an experimental feature of LXD right now,
mostly because CRIU still needs quite a bit of work to serialize all
useful kernel structures.
You may want to follow the "Sending bug reports" section of my post here
https://www.stgraber.org/2016/04/25/lxd-2-0-live-migration-912/
That way we should have all the needed data to look into this.
--
Stéphane Graber
Ubuntu developer
http://www.ubuntu.com
_______________________________________________
lxc-users mailing list
http://lists.linuxcontainers.org/listinfo/lxc-users

_______________________________________________
lxc-users mailing list
http://lists.linuxcontainers.org/listinfo/lxc-users