Moving to Docker

[RHCPNG]

I'm not familiar with the docker GUI of Synology, maybe that's good enough. But Portainer is widely used for managing docker containers. I like it. It is quite easy to create volumes and the sorts.

[kfxo]

@akbooer said in Moving to Docker:

I understand that to make any changes last across container/NAS restarts, I need to make the volumes external to the container, as per the above yaml. So this is my next step.

Any further insights welcomed. Perhaps Portainer is that next step?

You cannot create named volumes through the synology GUI. You will need to use portainer or you can ssh into your synology and run the manual commands as outlined by vwout/openluup

You can also do this manually. Start by creating docker volumes:

docker volume create openluup-env
docker volume create openluup-logs
docker volume create openluup-backups

Create an openLuup container, e.g. based on Alpine linux and mount the created (still empty) volumes:

docker run -d
-v openluup-env:/etc/cmh-ludl/
-v openluup-logs:/etc/cmh-ludl/logs/
-v openluup-backups:/etc/cmh-ludl/backup/
-p 3480:3480
vwout/openluup:alpine

[kfxo]

@akbooer
I have been messing with this today. I do not currently run openluup through docker so this may not even be the best way to do this but it is what I did to get it up and running and with the ability to easily see and manipulate all openluup files within "File Station" on the synology.

I created three folders on my synology:
/docker/openLuup/cmh-ludl
/docker/openLuup/logs
/docker/openLuup/backups

Then I created three volumes with a bind to the created folders
'openluup-env' bound to '/volume1/docker/openLuup/cmh-ludl'
'openluup-logs' bound to '/volume1/docker/openLuup/logs'
'openluup-backups' bound to '/volume1/docker/openLuup/backup'

I used portianer but you can ssh into your synology and use the command line to create these volumes with the binds, see this

Then I created the container using portainer making sure to set the correct ports and volume mappings, which can also be done in the command line with

docker run -d \
       -v openluup-env:/etc/cmh-ludl/ \
       -v openluup-logs:/etc/cmh-ludl/logs/ \
       -v openluup-backups:/etc/cmh-ludl/backup/ \
       -p 3480:3480
       vwout/openluup:alpine

Hope this helps.

Edit: The binds are not necessary, I only did it to make it easy to access the files. Without the bindings, the volumes are somewhat hidden on synology that is not easily accessible for example at '/volume1/@docker/volumes/openluup-env/_data'

[RHCPNG]

Good explanation, this is where it comes down to. But in the end, you probably want the bind to make your data persistent and, more important, easy acccessible.

[akbooer]

I'm still struggling with this. I've manually created some external folders, but can't get the multi-line command to work.

@vwout, following my new experience with AlpineWSL on a PC (which I assume to be something very similar to Docker) I created the whole of the cmh-ludl folder as one single external volume. This is really convenient. Is it possible to make the same configuration for a Docker image?

[mrFarmer]

Hi @vwout, can your docker image also be used on the arm64 platform (Pi4)? If not, how would I go about building one? I think with an Unbutu docker and then use the same setup as on a plain Pi.

I am setting up some new things on a Pi4 and came along this (https://github.com/SensorsIot/IOTstack) to use Dockers on a Pi. Looks like a very quick way to (re)build an environment from a basic starting point. Especially the split between user data and all else looks attractive.

Cheers Rene

[akbooer]

Why would you want to do that? It’s not as though installing Lua is difficult. What am I missing?

[RHCPNG]

@akbooer said in Moving to Docker:

I'm still struggling with this. I've manually created some external folders, but can't get the multi-line command to work.

@vwout, following my new experience with AlpineWSL on a PC (which I assume to be something very similar to Docker) I created the whole of the cmh-ludl folder as one single external volume. This is really convenient. Is it possible to make the same configuration for a Docker image?

I don't know what AlpineWSL is, but you can make a volume for your cmh-ludl folder and map it in vwout's docker container.

This is what it looks like in portainer, like a mapping. Really convenient, like you said.

[akbooer]

@rhcpng

Thanks for that. I guess my question is why these have to be done separately, rather than just making cmh-ludl/ (and all its sub folders) external (which, effectively is what I’ve done for WSL.)

I was trying to do it on the command line, since Portainer seemed to be several hundreds of megabytes, which seemed a bit of overkill just for this task (which, I think, is all I need it for.)

[RHCPNG]

You mean not splitting it up in backup, log and cmh-ludl? That's a choice of vwout. To be able to be flexible with what you store where, probably. You can do it with the command line too, but I'm not familiar with that. I don't think you have to do all mappings. Probably the cmh-ludl is enough, but I'm not sure.

[mrFarmer]

@akbooer Well, if I have a complete openLuup setup, except my data, in a Docker and I need to rebuild a system from scratch I can just run a script, restore my data and be back up and running. Creating a complete new system from scratch takes a lot more. Especially if you need to do Grafana, DB, webserver, ... All the packages I need to install again (i never document that well for the next time) etc.

[akbooer]

@mrfarmer

Ah, I see. More of a backup, than anything else, then.

[mrFarmer]

@akbooer a quick restore from a fatal crash of the Pi (SD/SSD) yes.

[vwout]

@akbooer As @RHCPNG said, you can easily do this, once you have a running setup by copying the contents of /etc/cmh-ludl/ to a local folder, restart the container with that folder mounted to /etc/cmh-ludl/.

The difference between using a volume and a folder mount is (amongst other details) how Docker handles this at first startup. When using a volume, Docker copies the contents of e.g. /etc/cmh-ludl/ when it is started with a empty new volume, to that volume. As of that moment all changes are kept in the volume and survive container restarts and updates.
A mounted folder also preserves all settings, but in contrary to volumes, Docker does not copy the original contents of the mount target to the folder at first startup. This means you need to store create the files needed in /etc/cmh-ludl/ yourself, which makes it harder to initially get start (except for one who masters openLuup ).

[PerH]

I thought i'd give this a stab, as i have some dependency issues.. Found an old laptop and installed Debian to test with.

I want the following apps to run on the machine:
openLuup
Z-Way
Domoticz
InfluxDB
Grafana
Miio Server (stupid implementation of domo plugin for my vacuum)

Any reason not to just have one docker each? They all use TCP/UDP for all communication (i use ser2net for usb ports)..

I've had to install python on the domoticz image i have, and therefore saved a new image. Where is this image stored?

[PerH]

@vwout: There is a choice between Debian and Alpine in your image, why? is there advatages to one or the other? If its just interface/packages in the container there wouldn't be a difference if you're not doing changes to it right? (which ideally is not nessecary)

[RHCPNG]

@perh I think the main point of dockers is to put every service in it's own docker. This way it is easier to manage with as less dependence as possible.

[akbooer]

@perh said in Moving to Docker:

There is a choice between Debian and Alpine in your image, why?

The Alpine image is somewhat smaller. It comes with a more limited set of Linux installed utilities, but who cares about that in the openLuup environment?

[PerH]

As long as it works..

New question: I've set up two containers (domoticz and miio server), and by default - they are on the same network. This network will however give the containers an IP at startup, and it seems to be first come - first served. Is there a way to give them static IP's in this internal docker network?
I tried docker run --IP=<IP> without success..

The plugin in Domo reaches miio server with that IP, so i need it to be the same after restarts!

[akbooer]

OK, now I have a problem.

It was all going so well until I realised that all incoming IP addresses were being mapped to 172.17.0.1by the LuaSocket library.

Reading the Docker docs: https://docs.docker.com/config/containers/container-networking/

"By default, the container is assigned an IP address for every Docker network it connects to. The IP address is assigned from the pool assigned to the network, so the Docker daemon effectively acts as a DHCP server for each container. Each network also has a default subnet mask and gateway."

But I don't understand, yet, how this works if I want a straight-forward mapping of IPs from my LAN into the Docker container.

It may be that the Synology Docker interface is not adequate for this and I have to revert to the command line?

Any advice/clarification much appreciated.