Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Activity
  • Jan 14 23:17

    ricco386 on upgrade-python3

    Updated requirements (compare)

  • Jan 14 22:50

    ricco386 on upgrade-python3

    Removed missing unicode (compare)

  • Jan 14 21:35

    ricco386 on upgrade-python3

    Removed django-transaction-hook… (compare)

  • Jan 14 19:23

    ricco386 on upgrade-python3

    Updated Django 2.1 required ren… (compare)

  • Jan 14 18:24
    jurajlutter opened #535
  • Jan 10 00:25

    YanChii on bhyve

    refactor compatible brands check (compare)

  • Jan 10 00:15

    YanChii on bhyve

    make kvm and bhyve brands compa… (compare)

  • Jan 09 22:33

    YanChii on bhyve

    fix node selection (compare)

  • Jan 09 21:23

    YanChii on bhyve

    implement bhyve disk model (compare)

  • Jan 09 19:21

    YanChii on bhyve

    add vnc_port attr on deploy (compare)

  • Jan 09 17:50

    YanChii on bhyve

    more checks (compare)

  • Jan 09 15:02

    YanChii on bhyve

    do a proper input settings vali… (compare)

  • Jan 09 13:49

    YanChii on bhyve

    various GUI fixes (compare)

  • Jan 09 01:37

    YanChii on bhyve

    fix node bhyve capability check (compare)

  • Jan 09 01:14

    YanChii on bhyve

    fix node bhyve capability check (compare)

  • Jan 09 01:01

    YanChii on bhyve

    add bootrom to gui; show only r… (compare)

  • Jan 08 23:22

    YanChii on bhyve

    add bootrom option; add hvm_typ… (compare)

  • Jan 07 22:33
    dependabot[bot] labeled #534
  • Jan 07 22:33
    dependabot[bot] opened #534
  • Jan 07 22:33

    dependabot[bot] on pip

    Bump lxml from 3.6.4 to 4.6.2 i… (compare)

Paolo Marcheschi
@paolomarcheschi_twitter
Hi @YanChii do you think is feasible to backup zones (.tgz) to the cloud?
We use backups scripts to backup other files in our infrastructure using rclone https://rclone.org/ there are a lot of providers available https://rclone.org/#providers
matrixbot
@matrixbot
@toybomb:matrix.org i had the same question a while ago. yanchii https://gist.github.com/cnrd/9b8d50a17a3f7860298337bbbb084d12
@toybomb:matrix.org i had the same question a while ago. yanchii mentioned that most scripts actually require the other side to have zfs. this rclone solution doesn't but isn't very well structured https://gist.github.com/cnrd/9b8d50a17a3f7860298337bbbb084d12
Paolo Marcheschi
@paolomarcheschi_twitter
Thank you
Jan Poctavek
@YanChii
there are several points of view on this topic:
  • one is that when you build your own cloud, it makes sense to have backups managed inside it... even offsite backups can be managed by DC. Example: install a remote DC node somewhere elsewhere and push backups there.
  • second is that you want to have backups outside the current orchestration system. The easiest way is to utilize file backups (instead of zfs send/receive) using DC and then have these files uploaded by some cron script anywhere you like.
Paolo Marcheschi
@paolomarcheschi_twitter
Thank you @YanChii
Jan Poctavek
@YanChii
of course, we can also integrate some public cloud backup functionality directly into DC (especially automated restores). It is just matter of priorities and maybe matter some help :). In case someone would be interested, it's not that hard - add appropriate functionality into esbackup tool https://github.com/erigones/esdc-ce/blob/master/bin/esbackup
when you watch logs, you can see calls to esbackup with required parameters during VM backups
Paolo Marcheschi
@paolomarcheschi_twitter
This is interesting , so it is possible to add more options like new compression (xz for example) or a hook to lunch a script at the end of compression.
Jan Poctavek
@YanChii
yes
whole DC is actually a pack of binaries called remotely by the API (using async message queue on the way)
Paolo Marcheschi
@paolomarcheschi_twitter
Hi Do you know if it is possible to convert a CN to HN and viceversa?
Jan Poctavek
@YanChii
HN is completely identical to CN after install. Just migrate VMs from admin datacenter to other CN and you have a HN ;).
Paolo Marcheschi
@paolomarcheschi_twitter
And the High availabilty of management VMs?
Jan Poctavek
@YanChii
(for completeness, you should add new CN's public ssh key to metadata of the admin VMs after migration... but that can be done also later)

And the High availabilty of management VMs?

That's a different story. But now I don't know what exactly do you mean in connection to HN/CN. Same migration rules apply.

Paolo Marcheschi
@paolomarcheschi_twitter
I'd like to have two HN to have Highly Available Central Management with Automatic Failover
Jan Poctavek
@YanChii
HA is done by deploying mgmt02 and mgmt03 VMs preferably on different CNs
Paolo Marcheschi
@paolomarcheschi_twitter
now I have 1 HN and several other CN
Jan Poctavek
@YanChii

now I have 1 HN and several other CN

now you have several CNs and one of them is hosting admin VMs

Paolo Marcheschi
@paolomarcheschi_twitter
yes
Jan Poctavek
@YanChii

you have several options before choosing mgmt HA because it is the most complicated option and it's not maintentance-free.

  1. setup periodic backup of admin VMs and if your HN breaks inrecoverably , follow the DC restore procedure: https://docs.danube.cloud/user-guide/howto/disaster-recovery.html#recovery-without-danube-cloud-api-or-gui

  2. setup VM replication for mgmt01 and if the HN disappears, just start the destination mgmt01 VM on the destination node

  3. setup HA. There are ansible, python and shell scripts to do that. But you will have corosync/pacemaker postgresql cluster and you should know how to recover it in case something goes wrong... the same as with any other database cluster.

Paolo Marcheschi
@paolomarcheschi_twitter
Thank you, the simpler the better
Darth HTTP
@DarthHTTP
hi all
don't run DC but vanilla smartos latest, experimenting with bhyve and i'd like to create a vm which boots via PXE.
anyone has experimented with this ?
Jan Poctavek
@YanChii
I didn't try PXE from within bhyve (yet). But this is not SmartOS specific and it should work exactly as in FreeBSD.
62 replies
Paolo Marcheschi
@paolomarcheschi_twitter

Hi Everybody
Today I tried to install the new LX image ubuntu 20.04 from https://github.com/omniosorg/lx-images

And it worked without any modification with DC 4.3.
These are the steps I used:

I have created a new LX server with DC using the latest ubuntu LX available 16.04
I copied the <UUID> of the created zone
I stopped the zone with DC
I went to the CN node via terminal
I created a working folder under /zones
mkdir /zones/WORK
cd /zones/WORK
I Moved the existing /zones/<UUID>/root folder in /zones/WORK/rootOLD
mvdir /zones/<UUID>/root /zones/WORK/rootOLD
I downloaded the omnios LX ubuntu 20.04 available in the github site:

wget --no-check-certificate https://github.com/omniosorg/lx-images/releases/download/2020-10-05_16-35-52/lx-ubuntu-20.04-2020-10-05_16-35-52.tar.xz

mkdir /zones/WORK/root
xz -d lx-ubuntu-20.04-2020-10-05_16-35-52.tar.xz
tar xvf lx-ubuntu-20.04-2020-10-05_16-35-52.tar -C root
mvdir root /zones/<UUID>/root

At this point I restarted the zone from DC and it booted correctly:
[root@node (DC) ~]# zlogin 16bd71ff-8dd4-43bf-b556-58723a289b90
[Connected to zone '16bd71ff-8dd4-43bf-b556-58723a289b90' pts/2]
Welcome to Ubuntu 20.04.1 LTS (GNU/Linux 4.4 x86_64)
Documentation: https://help.ubuntu.com
Management: https://landscape.canonical.com
Support: https://ubuntu.com/advantage
Last login: Thu Oct 22 07:13:57 UTC 2020 from zone:global on pts/4
root@16bd71ff-8dd4-43bf-b556-58723a289b90:~# ls
root@16bd71ff-8dd4-43bf-b556-58723a289b90:~# uname -a
Linux 16bd71ff-8dd4-43bf-b556-58723a289b90 4.4 BrandZ virtual linux x86_64 x86_64 x86_64 GNU/Linux

FilipFrancis
@FilipFrancis
Nice work
Jan Poctavek
@YanChii
Cool.
Before first start of the zone, you can do a snapshot and create an image from that snapshot.
Paolo Marcheschi
@paolomarcheschi_twitter
Ok I started the process again and now I have an image.
Jan Poctavek
@YanChii
if the images really work, we can automate it and publish them on images.danube.cloud. But before that I'd like to add metadata processing service into them (to enable setting ssh keys using mdata).
Paolo Marcheschi
@paolomarcheschi_twitter
It seems to work, I installed a new server from image
Paolo Marcheschi
@paolomarcheschi_twitter
well I tried to install postgres but it does not work :(
Paolo Marcheschi
@paolomarcheschi_twitter
but the same procedure does not work also with latest 16.04 LX for me
Jan Poctavek
@YanChii
does apt dist-upgrade work?
Paolo Marcheschi
@paolomarcheschi_twitter
yes
Paolo Marcheschi
@paolomarcheschi_twitter
devuan linux works better, and I installed postgres successfully
Paolo Marcheschi
@paolomarcheschi_twitter
I tried also linux void and it works
Paolo Marcheschi
@paolomarcheschi_twitter
Also joyent official repository now has linux void (20201016)
03e83dc2-0ff9-11eb-873f-071a5e00e534
matrixbot
@matrixbot
otis void linux seems to have some "good" concept
otis * void linux seems to have some "good" concepts
matrixbot
@matrixbot
toybomb Yeah I guess I get why devuan and void work
toybomb But void may actually allow me to run mailinabox by manually setting package versions
matrixbot
@matrixbot
toybomb cgroups makes a lot of current services unable to run
toybomb on the ubuntu 18.04 and 20.x images
toybomb * on the ubuntu 18.04 and 20.x lx zones
Paolo Marcheschi
@paolomarcheschi_twitter
Yes this is very annoying this is why I'd like to switch to bhyve for those that need ubuntu 20.04
I do not want to loose the versatility of LX for the rest services
matrixbot
@matrixbot
toybomb i'm kinda wondering what's needed for the cgroups to allow for those services
toybomb i spent a few days trying to get some services running last month when tried those images