Posts on Ramon Gonzalez https://rjgonza.com/posts/ Recent content in Posts on Ramon Gonzalez Hugo -- gohugo.io en <a href="https://creativecommons.org/licenses/by-nc/4.0/" target="_blank" rel="noopener">CC BY-NC 4.0</a> Tue, 25 May 2021 20:08:03 -0400 Names in Learning Review https://rjgonza.com/posts/2021/05/names-in-learning-review/ Tue, 25 May 2021 20:08:03 -0400 https://rjgonza.com/posts/2021/05/names-in-learning-review/ I recently read a post from Lorin Hochstein(@norootcause) that got me thinking a bit about my own stance on naming names in learning review. I currently leverage learning reviews, or as other may know them incident writeups, and some case post mortems (don&rsquo;t use this), as a time for someone or a group to reflect on a timeline and then make observations about an event (positive or negative). This is similar to the reference that Lorin points to from Alex Hidalgo(@ahidalgosre): I recently read a post from Lorin Hochstein(@norootcause) that got me thinking a bit about my own stance on naming names in learning review. I currently leverage learning reviews, or as other may know them incident writeups, and some case post mortems (don’t use this), as a time for someone or a group to reflect on a timeline and then make observations about an event (positive or negative). This is similar to the reference that Lorin points to from Alex Hidalgo(@ahidalgosre):

While Lorin prefers to name names in a writeup I would respectfully disagree. While I would love to normalize the fact that incidents are just aspects of a system, especially a complex one, I do not feel that most folks have the luxury of a mature enough organization that they can follow this path just yet. I applaud Lorin for pushing this agenda and hope that as an industry we all arrive at that place I think we are not there just yet. I also believe that even if names are more anonymous you would still get the folks that would read this over and say something like “This could have been me!”.

In my opinion learning reviews/incident writeups are paramount to learning and growing the organization, specifically the engineering side. When we conduct them we stress as much as we can that there is no blaming or shaming but there is accountability. So while we don’t need to say Ramon from systems typo’ed the branch he was pushing to, we would identify that changes from the system team were mistakenly pushed out, or something to that effect. While it is not incorrect to include Ramon’s name, I just don’t see the value in it, at least from my experience.

Even though I don’t subscribe to this particular school of thought (at least not at the moment I am writing this) I do hope that we will all eventually end up in a state where there is no concern with regard to naming names and the second victim phenomenon. Finally, remember to plan for failure rather than avoid it :).

]]> Ansible Code Organization https://rjgonza.com/posts/2021/04/ansible-code-organization/ Sun, 25 Apr 2021 10:58:20 -0400 https://rjgonza.com/posts/2021/04/ansible-code-organization/ At work the Ansible repo that I work with is not as organized as I&rsquo;d like. I&rsquo;d like to make sure that the one that I am starting to commit to in my Lab is not going to end up in the same state. In order to help keep it tidy I figured it would be a good idea to separate out some of the tasks that I have in the roles I am working on. At work the Ansible repo that I work with is not as organized as I’d like. I’d like to make sure that the one that I am starting to commit to in my Lab is not going to end up in the same state. In order to help keep it tidy I figured it would be a good idea to separate out some of the tasks that I have in the roles I am working on. Then I could call import_tasks on them in the main.yml with some conditionals. This would also allow me to resuse groups of tasks from one role in another. I started out with something like this:

tasks/tasks_b.yml
---
- name: tasks_b - 1
  tags: [never, tags_b]
  debug:
    msg: This is a test from the tasks_b tasks

tasks/tasks_a.yml
---
- name: tasks_a - 1
  tags: [never, tags_a]
  debug:
    msg: This is a test from the tasks_a tasks

tasks/main.yml
---
- include_tasks: "{{ role_path }}/tasks/tasks_a.yml"
  tags: [never, tags_a]

- include_tasks: "{{ role_path }}/tasks/tasks_b.yml"
  tags: [never, tags_b]

I was attempting to use the never reserved tag to make sure that a task was only executed when I specifically included the tag. I guess I misunderstood the documentation because the way I found that it works is that when you specify the never tag on a task it will only execute when you include any tag. So with the setup about and running:

ansible-playbook -i hosts playbooks/testing.yml -l worker1 -t tags_a

I would get the following output:

PLAY [all] *********************************************************************************************************************************************************************************************************

TASK [testing : include_tasks] *************************************************************************************************************************************************************************************
included: /home/ramon/code/Lab/ansible/playbooks/roles/testing/tasks/tasks_a.yml for worker1

TASK [testing : tasks_a - 1] ***************************************************************************************************************************************************************************************
ok: [worker1] => {
    "msg": "This is a test from the tasks_a tasks"
}

TASK [testing : include_tasks] *************************************************************************************************************************************************************************************
included: /home/ramon/code/Lab/ansible/playbooks/roles/testing/tasks/tasks_b.yml for worker1

TASK [testing : tasks_b - 1] ***************************************************************************************************************************************************************************************
ok: [worker1] => {
    "msg": "This is a test from the tasks_b tasks"
}

PLAY RECAP *********************************************************************************************************************************************************************************************************
worker1                    : ok=4    changed=0    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0

So even though I only included tags_a in the command I got the exection of both tasks with the never tag.

I couldn’t really find a workaround that seems correct so I ended up adding my own conditional to the import_tasks tasks to check the tags:

---
- import_tasks: "{{ role_path }}/tasks/tasks_a.yml"
  when: '"tags_a" in ansible_run_tags'

- import_tasks: "{{ role_path }}/tasks/tasks_b.yml"
  when: '"tags_b" in ansible_run_tags'

Now when I run the playbook with just the tags_a tag I only get those tasks and likewise for tags_b. Additionally when I don’t include any tags all both are skipped:

$ ansible-playbook playbooks/testing.yml -i hosts -l worker1 -t tags_a

PLAY [all] ******************************************************************************************************************************************************************************************************

TASK [testing : tasks_a - 1] ************************************************************************************************************************************************************************************
ok: [worker1] => {
    "msg": "This is a test from the tasks_a tasks"
}

TASK [testing : tasks_b - 1] ************************************************************************************************************************************************************************************
skipping: [worker1]

PLAY RECAP ******************************************************************************************************************************************************************************************************
worker1                    : ok=1    changed=0    unreachable=0    failed=0    skipped=1    rescued=0    ignored=0

$ ansible-playbook playbooks/testing.yml -i hosts -l worker1 -t tags_b

PLAY [all] ******************************************************************************************************************************************************************************************************

TASK [testing : tasks_b - 1] ************************************************************************************************************************************************************************************
ok: [worker1] => {
    "msg": "This is a test from the tasks_b tasks"
}

PLAY RECAP ******************************************************************************************************************************************************************************************************
worker1                    : ok=1    changed=0    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0

$ ansible-playbook playbooks/testing.yml -i hosts -l worker1

PLAY [all] ******************************************************************************************************************************************************************************************************
TASK [testing : tasks_a - 1] ************************************************************************************************************************************************************************************
skipping: [worker1]


TASK [testing : tasks_b - 1] ************************************************************************************************************************************************************************************
skipping: [worker1]

PLAY RECAP ******************************************************************************************************************************************************************************************************
worker1                    : ok=0    changed=0    unreachable=0    failed=0    skipped=2    rescued=0    ignored=0

I have commited this testing role to my Lab if you are interesting it adding something like that for you own test or just want to copy this:

]]> Home Ansible Setup https://rjgonza.com/posts/2021/04/home-ansible-setup/ Mon, 19 Apr 2021 10:24:05 -0400 https://rjgonza.com/posts/2021/04/home-ansible-setup/ Setting Ansible for My Home Lab Since the weather was so nice I figured it would be a great idea to take the day off and work on my home lab. To start off I know that I am pretty comfortable with Ansible so I&rsquo;d like to use that to build it all out. One thing that always bugged me was the directory structure. The first time I invested a lot into Ansible I went with the Alternative Directory Layout and it made things harder to leverage something across my environment. Setting Ansible for My Home Lab

Since the weather was so nice I figured it would be a great idea to take the day off and work on my home lab. To start off I know that I am pretty comfortable with Ansible so I’d like to use that to build it all out. One thing that always bugged me was the directory structure. The first time I invested a lot into Ansible I went with the Alternative Directory Layout and it made things harder to leverage something across my environment. Since then I’d like to think that I have matured and learned from my mistakes. I have also begun to understand the value and importance of a monorepo so I am going to go with the standard Directory Layout:

production                # inventory file for production servers
staging                   # inventory file for staging environment

group_vars/
   group1                 # here we assign variables to particular groups
   group2                 # ""
host_vars/
   hostname1              # if systems need specific variables, put them here
   hostname2              # ""

library/                  # if any custom modules, put them here (optional)
module_utils/             # if any custom module_utils to support modules, put them here (optional)
filter_plugins/           # if any custom filter plugins, put them here (optional)

site.yml                  # master playbook
webservers.yml            # playbook for webserver tier
dbservers.yml             # playbook for dbserver tier

roles/
    common/               # this hierarchy represents a "role"
        tasks/            #
            main.yml      #  <-- tasks file can include smaller files if warranted
        handlers/         #
            main.yml      #  <-- handlers file
        templates/        #  <-- files for use with the template resource
            ntp.conf.j2   #  <------- templates end in .j2
        files/            #
            bar.txt       #  <-- files for use with the copy resource
            foo.sh        #  <-- script files for use with the script resource
        vars/             #
            main.yml      #  <-- variables associated with this role
        defaults/         #
            main.yml      #  <-- default lower priority variables for this role
        meta/             #
            main.yml      #  <-- role dependencies
        library/          # roles can also include custom modules
        module_utils/     # roles can also include custom module_utils
        lookup_plugins/   # or other types of plugins, like lookup in this case

    webtier/              # same kind of structure as "common" was above, done for the webtier role
    monitoring/           # ""
    fooapp/               # ""

Adding a User

First off I created a new role for the purose of adding a user. I added my user, added a public key, and granted sudo privilege.

- name: Make sure my users is on the host
  become: yes
  user:
    name: ramon
    comment: "Ramon Gonzalez"

- name: Make sure to add my public key for ssh-key auth
  become: yes
  authorized_key:
    user: ramon
    key: "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2dy1i+6iNAdFcPVNOG75KVMAM6J87Gnux1jtHJgFAFdbg3tySyWlWcXwwTHV7RRWOGhSpwY5Llqj5E29db2pG1RQ+Xb794ShN+3z+egMkAEbeX1wqG6WkkT35Wn8FJLLrbp6Bkv9QkJnsB87hJCfnmp9KNv5aj3eLlFx6W8y6vbn2JlE00AUnZbSvXOqo5bWDDWwESzw9u49VIm4EyqT1P5oJQBT/Ia/RDfhop5u4zuBxsRLo1W8KE/l7QtuazQWuVT+unj239t9be+HkIsBTTgdikIgnane6s7zd+4GKCYIdORDSptRzpkiLfBPGii0MpQ8QCm+AHAVguOEWqhM+w=="
    state: present

- name: Allow my user to have passwordless sudo
  become: yes
  lineinfile:
    dest: /etc/sudoers
    state: present
    regexp: "^ramon"
    line: "ramon ALL=(ALL) NOPASSWD: ALL"
    validate: visudo -cf %s

Adding the Role to a Playbook

Then I took that role and incorporated to a playbook called common. The idea is that this is something that would want to do to any server in the lab.

- hosts: all

  roles:
    - add_user
- hosts: all

  roles:
    - add_user

Adding the Hosts to a Group

Finally I created entries for my hosts and then added the newest ones to a that I could easily target for this common playbook run against:

worker1 ansible_host=x.x.x.x
worker2 ansible_host=x.x.x.x

rp1 ansible_host=x.x.x.x
rp2 ansible_host=x.x.x.x
rp3 ansible_host=x.x.x.x
rp4 ansible_host=x.x.x.x
rp5 ansible_host=x.x.x.x

[pi_workers]
rp[1:5]

Execute the Playbook

Now I am able to run the playbook (I ran it a few times before so I don’t expect changes) to make sure things are in the state that I expect:

ramon@royrig:~/code/Lab/ansible (master)$ ansible-playbook -u pi -k -i hosts -l pi_workers playbooks/common.yml
SSH password: 

PLAY [all] *********************************************************************************************************************************************************************************************************

TASK [Gathering Facts] *********************************************************************************************************************************************************************************************
[WARNING]: Platform linux on host rp3 is using the discovered Python interpreter at /usr/bin/python, but future installation of another Python interpreter could change this. See
https://docs.ansible.com/ansible/2.9/reference_appendices/interpreter_discovery.html for more information.
ok: [rp3]
[WARNING]: Platform linux on host rp2 is using the discovered Python interpreter at /usr/bin/python, but future installation of another Python interpreter could change this. See
https://docs.ansible.com/ansible/2.9/reference_appendices/interpreter_discovery.html for more information.
ok: [rp2]
[WARNING]: Platform linux on host rp5 is using the discovered Python interpreter at /usr/bin/python, but future installation of another Python interpreter could change this. See
https://docs.ansible.com/ansible/2.9/reference_appendices/interpreter_discovery.html for more information.
ok: [rp5]
[WARNING]: Platform linux on host rp4 is using the discovered Python interpreter at /usr/bin/python, but future installation of another Python interpreter could change this. See
https://docs.ansible.com/ansible/2.9/reference_appendices/interpreter_discovery.html for more information.
ok: [rp4]
[WARNING]: Platform linux on host rp1 is using the discovered Python interpreter at /usr/bin/python, but future installation of another Python interpreter could change this. See
https://docs.ansible.com/ansible/2.9/reference_appendices/interpreter_discovery.html for more information.
ok: [rp1]

TASK [add_user : Make sure my users is on the host] ****************************************************************************************************************************************************************
ok: [rp5]
ok: [rp4]
ok: [rp3]
ok: [rp2]
ok: [rp1]

TASK [add_user : Make sure to add my public key for ssh-key auth] **************************************************************************************************************************************************
ok: [rp3]
ok: [rp4]
ok: [rp5]
ok: [rp2]
ok: [rp1]

TASK [add_user : Allow my user to have passwordless sudo] **********************************************************************************************************************************************************
ok: [rp4]
ok: [rp3]
ok: [rp5]
ok: [rp2]
ok: [rp1]

PLAY RECAP *********************************************************************************************************************************************************************************************************
rp1                        : ok=4    changed=0    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0   
rp2                        : ok=4    changed=0    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0   
rp3                        : ok=4    changed=0    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0   
rp4                        : ok=4    changed=0    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0   
rp5                        : ok=4    changed=0    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0   

ramon@royrig:~/code/Lab/ansible (master)$

Trying It Out

If all went as expected then I should be able to ssh right to the host and then run a sudo command.

ramon@royrig:~/code/Lab/ansible (master)$ ssh rp2
The authenticity of host 'rp2 (x.x.x.x)' can't be established.
ECDSA key fingerprint is SHA256:yH0Zmu+BPxv+zWkdoKY1oYIxB4Xd93EdEoHIc2pO/xI.
Are you sure you want to continue connecting (yes/no/[fingerprint])? yes
Warning: Permanently added 'rp2' (ECDSA) to the list of known hosts.
Linux rp2 5.10.17-v7+ #1403 SMP Mon Feb 22 11:29:51 GMT 2021 armv7l

The programs included with the Debian GNU/Linux system are free software;
the exact distribution terms for each program are described in the
individual files in /usr/share/doc/*/copyright.

Debian GNU/Linux comes with ABSOLUTELY NO WARRANTY, to the extent
permitted by applicable law.

SSH is enabled and the default password for the 'pi' user has not been changed.
This is a security risk - please login as the 'pi' user and type 'passwd' to set a new password.


Wi-Fi is currently blocked by rfkill.
Use raspi-config to set the country before use.

ramon@rp2:~ $ sudo echo

ramon@rp2:~ $

Success!

]]> Git Submodules... https://rjgonza.com/posts/2021/04/git-submodules.../ Sun, 04 Apr 2021 21:23:26 -0400 https://rjgonza.com/posts/2021/04/git-submodules.../ I know I am not supposed to use them&hellip; I love static sites, and I run this one with Hugo &ndash; it&rsquo;s awesome. Anyways, the way I add the theme to the site is by including the git repo of the theme in the repo that tracks this site. It is not just dropped in mess with all the git configurations. It is added as a git submodule to mess with all the git configurations. I know I am not supposed to use them…

I love static sites, and I run this one with Hugo – it’s awesome. Anyways, the way I add the theme to the site is by including the git repo of the theme in the repo that tracks this site. It is not just dropped in mess with all the git configurations. It is added as a git submodule to mess with all the git configurations. I have read countless articles, and have has first hand expierence, about how submodules are usually not worth the headache. I had to re-learn that lesson again today.

After trying to get back into posting on the blog I was trying to see some changes locally before I pushed to my dev branch. I have the dev branch automatically building on Netlify but I wanted a “cleaner” git history so I wanted to see my unstanged changes locally. So I fired up the server on my hugo install:

hugo -D server
WARN 2021/04/04 21:42:24 found no layout file for "HTML" for kind "page": You should create a template file which matches Hugo Layouts Lookup Rules for this combination.
WARN 2021/04/04 21:42:24 found no layout file for "HTML" for kind "page": You should create a template file which matches Hugo Layouts Lookup Rules for this combination.
WARN 2021/04/04 21:42:24 found no layout file for "HTML" for kind "page": You should create a template file which matches Hugo Layouts Lookup Rules for this combination.
WARN 2021/04/04 21:42:24 found no layout file for "HTML" for kind "page": You should create a template file which matches Hugo Layouts Lookup Rules for this combination.
WARN 2021/04/04 21:42:24 found no layout file for "HTML" for kind "home": You should create a template file which matches Hugo Layouts Lookup Rules for this combination.
WARN 2021/04/04 21:42:24 found no layout file for "HTML" for kind "taxonomy": You should create a template file which matches Hugo Layouts Lookup Rules for this combination.
WARN 2021/04/04 21:42:24 found no layout file for "HTML" for kind "taxonomy": You should create a template file which matches Hugo Layouts Lookup Rules for this combination.
WARN 2021/04/04 21:42:24 found no layout file for "HTML" for kind "taxonomy": You should create a template file which matches Hugo Layouts Lookup Rules for this combination.
WARN 2021/04/04 21:42:24 found no layout file for "HTML" for kind "taxonomy": You should create a template file which matches Hugo Layouts Lookup Rules for this combination.
WARN 2021/04/04 21:42:24 found no layout file for "HTML" for kind "taxonomy": You should create a template file which matches Hugo Layouts Lookup Rules for this combination.
WARN 2021/04/04 21:42:24 found no layout file for "HTML" for kind "taxonomy": You should create a template file which matches Hugo Layouts Lookup Rules for this combination.
WARN 2021/04/04 21:42:24 found no layout file for "HTML" for kind "section": You should create a template file which matches Hugo Layouts Lookup Rules for this combination.
WARN 2021/04/04 21:42:24 found no layout file for "HTML" for kind "taxonomyTerm": You should create a template file which matches Hugo Layouts Lookup Rules for this combination.
WARN 2021/04/04 21:42:24 found no layout file for "HTML" for kind "taxonomyTerm": You should create a template file which matches Hugo Layouts Lookup Rules for this combination.
WARN 2021/04/04 21:42:24 found no layout file for "HTML" for kind "taxonomy": You should create a template file which matches Hugo Layouts Lookup Rules for this combination.
WARN 2021/04/04 21:42:24 found no layout file for "HTML" for kind "taxonomy": You should create a template file which matches Hugo Layouts Lookup Rules for this combination.
WARN 2021/04/04 21:42:24 found no layout file for "HTML" for kind "taxonomy": You should create a template file which matches Hugo Layouts Lookup Rules for this combination.

The -D will build the drafts so I can see unpublished posts.

After seeing a bunch of “warnings” (I assumed there might be some issue because I am running locally) I was presented with a blank page… I assumed that server was not working. I am running the server via wsl and trying to get to it from my windows desktop targeting localhost:1313. So I tried a few different browsers – nothing. Then I tried running nc from the wsl terminal:

ramon@-$ nc localhost 1313

HTTP/1.1 400 Bad Request
Content-Type: text/plain; charset=utf-8
Connection: close

400 Bad Request
ramon@-$

So I can confirm that the server is, in fact running, and that it was responding and serving something. So I then moved to my windows desktop and attempted a telnet. At first I got an error, and then realized that I needed to “enable” telnet: windows features telnet

After a short wait I had good ole telnet and was able to run open localhost 1313 telnet

At this point I am thinking there is just some problem with hugo. After enableing more logging by passing the -v flag to the hugo server command it finally hit me that I am just seeing a blank page because the site cannot be rendered properly and that is handled by the theme. To test out this theory I enabled another theme by updating the config.toml

# theme = "hello-friend-ng"
theme = "ananke"

And then made sure to add the theme to my repo:

git submodule add https://github.com/theNewDynamic/gohugo-theme-ananke.git themes/ananke

As soon as I saw the new theme next to my original one, I knew something was up… The new theme had files in the directory, and mine was empty… After launching the hugo server again, I was no longer presented with a blank page at localhost:1313. Finally I realized that I had a directory that was supposed to be a submodule and all the files were missing. So I just checked around realy quick on how to run a “git pull” on a submodule and found this:

git submodule update --init --recursive

No luck, still no files. So I said forget it, I will just delete the folder and then recreate the submodule. This led to new problems becasue that directory was being tracked by git as a submodule. I didn’t want to commit any of this and futher pollute the history. The next step was to check the index with ls-files. This turned out to do the trick for me.

git ls-files -- themes/

This showed the directory! At that point I just removed it with:

git rm themes/hello-friend-ng

Finally I was able to add it back

git submodule add https://github.com/rhazdon/hugo-theme-hello-friend-ng.git themes/hello-friend-ng

Hopefully putting this info on the blog will help me get to it faster, because I just added the submodule back to my repo :).

]]> Worker Setup - Part 1 https://rjgonza.com/posts/2021/04/worker-setup-part-1/ Sat, 03 Apr 2021 10:22:17 -0400 https://rjgonza.com/posts/2021/04/worker-setup-part-1/ It&rsquo;s Been A Long Time I have neglected my blog for a while and have really been out of touch with tech for a bit. In my current role at my full time job I am pretty much hands off :(. In any case, I figured this would be a good time to get back into working on my lab at home and wanted to begin by automating the steps to bring a worker online. It’s Been A Long Time

I have neglected my blog for a while and have really been out of touch with tech for a bit. In my current role at my full time job I am pretty much hands off :(. In any case, I figured this would be a good time to get back into working on my lab at home and wanted to begin by automating the steps to bring a worker online. I have been away so long I needed to review the hugo quickstart to remember how to add a post to the blog. The approach I am going to take is to start off by going through all the steps from the beginning and then review and automate each part.

Step 1

First off I will grab one of these old Intel NUCs that I have lying around. nuc Then I wired it up to my network, power, and one of the other ports on my monitor. I like to do all of my work at the same work station so I tend to use the pip features that my monitor has: osd

Prepare the Image

Grabbing the OS ISO

Next I head over to CentOS to grab the OS I’d like to provision on the host (this will soon be replaced with something from the folks over at Rocky Linux :)).

Preparing the Media

Since I don’t have anything setup to serve out these images yet, I need to do it the old fashioned way with bootable media. I use rufus for creating bootable media on windows, works like a charm.

Install

Now I just slap the stick in the NUC and boot with the PIP display running. I had to take a screen cap of it with my phone because the snipping tool does not see the PIP display. pip I walk throught the manual install of CentOS on the worker. As soon as it’s complete I just make sure to change the address on NIC to be static and then reserve it in my dhcp config: static_nic dhcpd Then I am good to shut it down and place it where it will remain and boot it back up. worker_stack

Configure

Now I need to make sure that I have all the tools and things that I will need installed on this host to run whatever services I decide I would like to deploy here.

]]> Setting Up a Worker for Home Lab https://rjgonza.com/posts/2019/10/setting-up-a-worker-for-home-lab/ Sat, 19 Oct 2019 09:20:02 -0400 https://rjgonza.com/posts/2019/10/setting-up-a-worker-for-home-lab/ Home Lab My home lab setup currently consists of a single &ldquo;worker&rdquo; (where I run portainer and all of my containers for the services my home needs) and a small Ubiquity setup. I serves me well and I am very please with it so far. I wanted to start to spin up some more containers and also test some thing out and figure it would be a good idea to add some more resources to the pool. Home Lab

lab My home lab setup currently consists of a single “worker” (where I run portainer and all of my containers for the services my home needs) and a small Ubiquity setup. I serves me well and I am very please with it so far. I wanted to start to spin up some more containers and also test some thing out and figure it would be a good idea to add some more resources to the pool. I was about to hook up my desk setup to the new worker and I thought that I would really like if this was automated…

Steps to Automate to Add a Worker to the Lab

Get MAC address of the NIC

Manual

I cabled up the new worker to my desktop switch and waited a few seconds for him to show up on my network and then used a fixed address and renamed him. worker_unify

Automated

Reserve IP address and associate MAC address on DHCP server

Manual

Then I chose an alias for him and allowed the IP to be reserved on the DHCP server. worker_alias worker_fixedIP

Automated

Add DNS Entries Pointing at the New Worker

Manual

I am using an awesome dnsmasq container that has a cute go wrapper to serve a UI for the config. At the bottom of the config I just add something like this: 

456
457
458
459
460
461
462

conf-dir=/etc/dnsmasq.d
server=1.1.1.1
server=8.8.8.8
server=/gonzalez/xxx.xxx.xxx.xxx
address=/worker1.expo.gonzalez/xxx.xxx.xxx.xxx
address=/unifi.expo.gonzalez/xxx.xxx.xxx.xxx
address=/worker2.expo.gonzalez/xxx.xxx.xxx.xxx

Automated

Netboot Worker with CentOS

Manual

In order to work on the build I decided that I would just install via USB while I am still setting up the environment and tools to have a worker bootstrapping environment.

Automated

Ansible Playbook Run to Hammer Worker Into the Desired State

Manual

In order to know what packages and settings I needed I figured that I would just ssh over to the newly built host and then start setting it up. I would record all the steps and things I wanted to change and then look for existing playbook on Ansible Galaxy for it. If it was there I would pull that module down to my repo (maybe as a submodule or subtree). If I couldn’t find it then I would just build it up myself – hopefully it would something that could be helpful to someone else.

Install VIM

Need a real editor so I first need to grab vi 

  1
  2
  3
  4
  5
  6
  7
  8
  9
 10
 11
 12
 13
 14
 15
 16
 17
 18
 19
 20
 21
 22
 23
 24
 25
 26
 27
 28
 29
 30
 31
 32
 33
 34
 35
 36
 37
 38
 39
 40
 41
 42
 43
 44
 45
 46
 47
 48
 49
 50
 51
 52
 53
 54
 55
 56
 57
 58
 59
 60
 61
 62
 63
 64
 65
 66
 67
 68
 69
 70
 71
 72
 73
 74
 75
 76
 77
 78
 79
 80
 81
 82
 83
 84
 85
 86
 87
 88
 89
 90
 91
 92
 93
 94
 95
 96
 97
 98
 99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246

[root@localhost ~]# yum install vim
Failed to set locale, defaulting to C
Loaded plugins: fastestmirror
Determining fastest mirrors
* base: mirror.math.princeton.edu
* extras: mirror.math.princeton.edu
* updates: mirror.math.princeton.edu
base                                                                     | 3.6 kB  00:00:00
extras                                                                   | 2.9 kB  00:00:00
updates                                                                  | 2.9 kB  00:00:00
(1/4): base/7/x86_64/group_gz                                            | 165 kB  00:00:00
(2/4): extras/7/x86_64/primary_db                                        | 152 kB  00:00:00
(3/4): updates/7/x86_64/primary_db                                       | 1.9 MB  00:00:00
(4/4): base/7/x86_64/primary_db                                          | 6.0 MB  00:00:00
Resolving Dependencies
--> Running transaction check
---> Package vim-enhanced.x86_64 2:7.4.629-6.el7 will be installed
--> Processing Dependency: vim-common = 2:7.4.629-6.el7 for package: 2:vim-enhanced-7.4.629-6.el7.x86_64
--> Processing Dependency: perl(:MODULE_COMPAT_5.16.3) for package: :vim-enhanced-7.4.629-6.el7.x86_64
--> Processing Dependency: libperl.so()(64bit) for package: 2:vim-enhanced-7.4.629-6.el7.x86_64
--> Running transaction check
---> Package perl.x86_64 4:5.16.3-294.el7_6 will be installed
--> Processing Dependency: perl(Socket) >= 1.3 for package: 4:perl-5.16.3-294.el7_6.x86_64
--> Processing Dependency: perl(Scalar::Util) >= 1.10 for package :perl-5.16.3-294.el7_6.x86_64
--> Processing Dependency: perl-macros for package: 4:perl-5.16.3-294.el7_6.x86_64
--> Processing Dependency: perl(threads::shared) for package: 4:perl-5.16.3-294.el7_6.x86_64
--> Processing Dependency: perl(threads) for package: 4:perl-5.16.3-294.el7_6.x86_64
--> Processing Dependency: perl(constant) for package: 4:perl-5.16.3-294.el7_6.x86_64
--> Processing Dependency: perl(Time::Local) for package: 4:perl-5.16.3-294.el7_6.x86_64
--> Processing Dependency: perl(Time::HiRes) for package: 4:perl-5.16.3-294.el7_6.x86_64
--> Processing Dependency: perl(Storable) for package: 4:perl-5.16.3-294.el7_6.x86_64
--> Processing Dependency: perl(Socket) for package: 4:perl-5.16.3-294.el7_6.x86_64
--> Processing Dependency: perl(Scalar::Util) for package: 4:perl-5.16.3-294.el7_6.x86_64
--> Processing Dependency: perl(Pod::Simple::XHTML) for package: 4:perl-5.16.3-294.el7_6.x86_64
--> Processing Dependency: perl(Pod::Simple::Search) for package: 4:perl-5.16.3-294.el7_6.x86_64
--> Processing Dependency: perl(Getopt::Long) for package: 4:perl-5.16.3-294.el7_6.x86_64
--> Processing Dependency: perl(Filter::Util::Call) for package: 4:perl-5.16.3-294.el7_6.x86_64
--> Processing Dependency: perl(File::Temp) for package: 4:perl-5.16.3-294.el7_6.x86_64
--> Processing Dependency: perl(File::Spec::Unix) for package: 4:perl-5.16.3-294.el7_6.x86_64
--> Processing Dependency: perl(File::Spec::Functions) for package: :perl-5.16.3-294.el7_6.x86_64
--> Processing Dependency: perl(File::Spec) for package: 4:perl-5.16.3-294.el7_6.x86_64
--> Processing Dependency: perl(File::Path) for package: 4:perl-5.16.3-294.el7_6.x86_64
--> Processing Dependency: perl(Exporter) for package: 4:perl-5.16.3-294.el7_6.x86_64
--> Processing Dependency: perl(Cwd) for package: 4:perl-5.16.3-294.el7_6.x86_64
--> Processing Dependency: perl(Carp) for package: 4:perl-5.16.3-294.el7_6.x86_64
---> Package perl-libs.x86_64 4:5.16.3-294.el7_6 will be installed
---> Package vim-common.x86_64 2:7.4.629-6.el7 will be installed
--> Processing Dependency: vim-filesystem for package: 2:vim-common-7.4.629-6.el7.x86_64
--> Running transaction check
---> Package perl-Carp.noarch 0:1.26-244.el7 will be installed
---> Package perl-Exporter.noarch 0:5.68-3.el7 will be installed
---> Package perl-File-Path.noarch 0:2.09-2.el7 will be installed
---> Package perl-File-Temp.noarch 0:0.23.01-3.el7 will be installed
---> Package perl-Filter.x86_64 0:1.49-3.el7 will be installed
---> Package perl-Getopt-Long.noarch 0:2.40-3.el7 will be installed
--> Processing Dependency: perl(Pod::Usage) >= 1.14 for package: perl-Getopt-Long-2.40-3.el7.noarch
--> Processing Dependency: perl(Text::ParseWords) for package: perl-Getopt-Long-2.40-3.el7.noarch
---> Package perl-PathTools.x86_64 0:3.40-5.el7 will be installed
---> Package perl-Pod-Simple.noarch 1:3.28-4.el7 will be installed
--> Processing Dependency: perl(Pod::Escapes) >= 1.04 for package: 1:perl-Pod-Simple-3.28-4.el7.noarch
--> Processing Dependency: perl(Encode) for package: 1:perl-Pod-Simple-3.28-4.el7.noarch
---> Package perl-Scalar-List-Utils.x86_64 0:1.27-248.el7 will be installed
---> Package perl-Socket.x86_64 0:2.010-4.el7 will be installed
---> Package perl-Storable.x86_64 0:2.45-3.el7 will be installed
---> Package perl-Time-HiRes.x86_64 4:1.9725-3.el7 will be installed
---> Package perl-Time-Local.noarch 0:1.2300-2.el7 will be installed
---> Package perl-constant.noarch 0:1.27-2.el7 will be installed
---> Package perl-macros.x86_64 4:5.16.3-294.el7_6 will be installed
---> Package perl-threads.x86_64 0:1.87-4.el7 will be installed
---> Package perl-threads-shared.x86_64 0:1.43-6.el7 will be installed
---> Package vim-filesystem.x86_64 2:7.4.629-6.el7 will be installed
--> Running transaction check
---> Package perl-Encode.x86_64 0:2.51-7.el7 will be installed
---> Package perl-Pod-Escapes.noarch 1:1.04-294.el7_6 will be installed
---> Package perl-Pod-Usage.noarch 0:1.63-3.el7 will be installed
--> Processing Dependency: perl(Pod::Text) >= 3.15 for package: perl-Pod-Usage-1.63-3.el7.noarch
--> Processing Dependency: perl-Pod-Perldoc for package: perl-Pod-Usage-1.63-3.el7.noarch
---> Package perl-Text-ParseWords.noarch 0:3.29-4.el7 will be installed
--> Running transaction check
---> Package perl-Pod-Perldoc.noarch 0:3.20-4.el7 will be installed
--> Processing Dependency: perl(parent) for package: perl-Pod-Perldoc-3.20-4.el7.noarch
--> Processing Dependency: perl(HTTP::Tiny) for package: perl-Pod-Perldoc-3.20-4.el7.noarch
---> Package perl-podlators.noarch 0:2.5.1-3.el7 will be installed
--> Running transaction check
---> Package perl-HTTP-Tiny.noarch 0:0.033-3.el7 will be installed
---> Package perl-parent.noarch 1:0.225-244.el7 will be installed
--> Finished Dependency Resolution

Dependencies Resolved

=========================================================================================================================================
Package                                   Arch                      Version                               Repository               Size 
=========================================================================================================================================
Installing:
 vim-enhanced                              x86_64                    2:7.4.629-6.el7                       base                    1.1 M
 Installing for dependencies:
 perl                                      x86_64                    4:5.16.3-294.el7_6                    base                    8.0 M 
 perl-Carp                                 noarch                    1.26-244.el7                          base                     19 k
 perl-Encode                               x86_64                    2.51-7.el7                            base                    1.5 M 
 perl-Exporter                             noarch                    5.68-3.el7                            base                     28 k 
 perl-File-Path                            noarch                    2.09-2.el7                            base                     26 k 
 perl-File-Temp                            noarch                    0.23.01-3.el7                         base                     56 k 
 perl-Filter                               x86_64                    1.49-3.el7                            base                     76 k 
 perl-Getopt-Long                          noarch                    2.40-3.el7                            base                     56 k 
 perl-HTTP-Tiny                            noarch                    0.033-3.el7                           base                     38 k 
 perl-PathTools                            x86_64                    3.40-5.el7                            base                     82 k 
 perl-Pod-Escapes                          noarch                    1:1.04-294.el7_6                      base                     51 k 
 perl-Pod-Perldoc                          noarch                    3.20-4.el7                            base                     87 k 
 perl-Pod-Simple                           noarch                    1:3.28-4.el7                          base                    216 k 
 perl-Pod-Usage                            noarch                    1.63-3.el7                            base                     27 k 
 perl-Scalar-List-Utils                    x86_64                    1.27-248.el7                          base                     36 k 
 perl-Socket                               x86_64                    2.010-4.el7                           base                     49 k 
 perl-Storable                             x86_64                    2.45-3.el7                            base                     77 k 
 perl-Text-ParseWords                      noarch                    3.29-4.el7                            base                     14 k 
 perl-Time-HiRes                           x86_64                    4:1.9725-3.el7                        base                     45 k 
 perl-Time-Local                           noarch                    1.2300-2.el7                          base                     24 k 
 perl-constant                             noarch                    1.27-2.el7                            base                     19 k 
 perl-libs                                 x86_64                    4:5.16.3-294.el7_6                    base                    688 k 
 perl-macros                               x86_64                    4:5.16.3-294.el7_6                    base                     44 k 
 perl-parent                               noarch                    1:0.225-244.el7                       base                     12 k 
 perl-podlators                            noarch                    2.5.1-3.el7                           base                    112 k 
 perl-threads                              x86_64                    1.87-4.el7                            base                     49 k 
 perl-threads-shared                       x86_64                    1.43-6.el7                            base                     39 k 
 vim-common                                x86_64                    2:7.4.629-6.el7                       base                    5.9 M  
 vim-filesystem                            x86_64                    2:7.4.629-6.el7                       base                     11 k 
Transaction Summary
=========================================================================================================================================
Install  1 Package (+29 Dependent packages)

Total download size: 18 M
Installed size: 60 M
Is this ok [y/d/N]: y
Downloading packages:
(1/30): perl-Carp-1.26-244.el7.noarch.rpm                                                                         |  19 kB  00:00:00
(2/30): perl-Exporter-5.68-3.el7.noarch.rpm                                                                       |  28 kB  00:00:00
(3/30): perl-Encode-2.51-7.el7.x86_64.rpm                                                                         | 1.5 MB  00:00:00
(4/30): perl-File-Path-2.09-2.el7.noarch.rpm                                                                      |  26 kB  00:00:00
(5/30): perl-Getopt-Long-2.40-3.el7.noarch.rpm                                                                    |  56 kB  00:00:00
(6/30): perl-HTTP-Tiny-0.033-3.el7.noarch.rpm                                                                     |  38 kB  00:00:00
(7/30): perl-PathTools-3.40-5.el7.x86_64.rpm                                                                      |  82 kB  00:00:00
(8/30): perl-Pod-Escapes-1.04-294.el7_6.noarch.rpm                                                                |  51 kB  00:00:00
(9/30): perl-Pod-Perldoc-3.20-4.el7.noarch.rpm                                                                    |  87 kB  00:00:0
(10/30): perl-Pod-Simple-3.28-4.el7.noarch.rpm                                                                    | 216 kB  00:00:00
(11/30): perl-File-Temp-0.23.01-3.el7.noarch.rpm                                                                  |  56 kB  00:00:00
(12/30): perl-Pod-Usage-1.63-3.el7.noarch.rpm                                                                     |  27 kB  00:00:00
(13/30): perl-Scalar-List-Utils-1.27-248.el7.x86_64.rpm                                                           |  36 kB  00:00:00
(14/30): perl-Socket-2.010-4.el7.x86_64.rpm                                                                       |  49 kB  00:00:00
(15/30): perl-Filter-1.49-3.el7.x86_64.rpm                                                                        |  76 kB  00:00:00
(16/30): perl-Storable-2.45-3.el7.x86_64.rpm                                                                      |  77 kB  00:00:00
(17/30): perl-Text-ParseWords-3.29-4.el7.noarch.rpm                                                               |  14 kB  00:00:00
(18/30): perl-Time-HiRes-1.9725-3.el7.x86_64.rpm                                                                  |  45 kB  00:00:00
(19/30): perl-constant-1.27-2.el7.noarch.rpm                                                                      |  19 kB  00:00:00
(20/30): perl-macros-5.16.3-294.el7_6.x86_64.rpm                                                                  |  44 kB  00:00:00
(21/30): perl-Time-Local-1.2300-2.el7.noarch.rpm                                                                  |  24 kB  00:00:00
(22/30): perl-libs-5.16.3-294.el7_6.x86_64.rpm                                                                    | 688 kB  00:00:00
(23/30): perl-parent-0.225-244.el7.noarch.rpm                                                                     |  12 kB  00:00:00
(24/30): perl-threads-shared-1.43-6.el7.x86_64.rpm                                                                |  39 kB  00:00:00
(25/30): perl-podlators-2.5.1-3.el7.noarch.rpm                                                                    | 112 kB  00:00:00
(26/30): perl-threads-1.87-4.el7.x86_64.rpm                                                                       |  49 kB  00:00:00
(27/30): perl-5.16.3-294.el7_6.x86_64.rpm                                                                         | 8.0 MB  00:00:00
(28/30): vim-filesystem-7.4.629-6.el7.x86_64.rpm                                                                  |  11 kB  00:00:00
(29/30): vim-enhanced-7.4.629-6.el7.x86_64.rpm                                                                    | 1.1 MB  00:00:00
(30/30): vim-common-7.4.629-6.el7.x86_64.rpm                                                                      | 5.9 MB  00:00:00
-----------------------------------------------------------------------------------------------------------------------------------------
Total                                                                                                     17 MB/s |  18 MB  00:00:01
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
  Installing : 1:perl-parent-0.225-244.el7.noarch                                                                                   1/30
  Installing : perl-HTTP-Tiny-0.033-3.el7.noarch                                                                                    2/30
  Installing : perl-podlators-2.5.1-3.el7.noarch                                                                                    3/30
  Installing : perl-Pod-Perldoc-3.20-4.el7.noarch                                                                                   4/30
  Installing : 1:perl-Pod-Escapes-1.04-294.el7_6.noarch                                                                             5/30
  Installing : perl-Text-ParseWords-3.29-4.el7.noarch                                                                               6/30
  Installing : perl-Encode-2.51-7.el7.x86_64                                                                                        7/30
  Installing : perl-Pod-Usage-1.63-3.el7.noarch                                                                                     8/30
  Installing : 4:perl-libs-5.16.3-294.el7_6.x86_64                                                                                  9/30
  Installing : 4:perl-macros-5.16.3-294.el7_6.x86_64                                                                               10/30
  Installing : perl-Storable-2.45-3.el7.x86_64                                                                                     11/30
  Installing : perl-Exporter-5.68-3.el7.noarch                                                                                     12/30
  Installing : perl-constant-1.27-2.el7.noarch                                                                                     13/30
  Installing : perl-Time-Local-1.2300-2.el7.noarch                                                                                 14/30
  Installing : perl-Carp-1.26-244.el7.noarch                                                                                       15/30
  Installing : 4:perl-Time-HiRes-1.9725-3.el7.x86_64                                                                               16/30
  Installing : perl-PathTools-3.40-5.el7.x86_64                                                                                    17/30
  Installing : perl-Scalar-List-Utils-1.27-248.el7.x86_64                                                                          18/30
  Installing : perl-File-Temp-0.23.01-3.el7.noarch                                                                                 19/30
  Installing : perl-File-Path-2.09-2.el7.noarch                                                                                    20/30
  Installing : perl-threads-shared-1.43-6.el7.x86_64                                                                               21/30
  Installing : perl-threads-1.87-4.el7.x86_64                                                                                      22/30
  Installing : perl-Filter-1.49-3.el7.x86_64                                                                                       23/30
  Installing : perl-Socket-2.010-4.el7.x86_64                                                                                      24/30
  Installing : 1:perl-Pod-Simple-3.28-4.el7.noarch                                                                                 25/30
  Installing : perl-Getopt-Long-2.40-3.el7.noarch                                                                                  26/30
  Installing : 4:perl-5.16.3-294.el7_6.x86_64                                                                                      27/30
  Installing : 2:vim-filesystem-7.4.629-6.el7.x86_64                                                                               28/30
  Installing : 2:vim-common-7.4.629-6.el7.x86_64                                                                                   29/30
  Installing : 2:vim-enhanced-7.4.629-6.el7.x86_64                                                                                 30/30
  Verifying  : perl-HTTP-Tiny-0.033-3.el7.noarch                                                                                    1/30
  Verifying  : perl-threads-shared-1.43-6.el7.x86_64                                                                                2/30
  Verifying  : perl-Storable-2.45-3.el7.x86_64                                                                                      3/30
  Verifying  : 1:perl-Pod-Escapes-1.04-294.el7_6.noarch                                                                             4/30
  Verifying  : perl-Exporter-5.68-3.el7.noarch                                                                                      5/30
  Verifying  : perl-constant-1.27-2.el7.noarch                                                                                      6/30
  Verifying  : perl-PathTools-3.40-5.el7.x86_64                                                                                     7/30
  Verifying  : 1:perl-parent-0.225-244.el7.noarch                                                                                   8/30
  Verifying  : 4:perl-libs-5.16.3-294.el7_6.x86_64                                                                                  9/30
  Verifying  : perl-File-Temp-0.23.01-3.el7.noarch                                                                                 10/30
  Verifying  : 1:perl-Pod-Simple-3.28-4.el7.noarch                                                                                 11/30
  Verifying  : perl-Time-Local-1.2300-2.el7.noarch                                                                                 12/30
  Verifying  : 4:perl-macros-5.16.3-294.el7_6.x86_64                                                                               13/30
  Verifying  : 4:perl-5.16.3-294.el7_6.x86_64                                                                                      14/30
  Verifying  : 2:vim-enhanced-7.4.629-6.el7.x86_64                                                                                 15/30
  Verifying  : perl-Carp-1.26-244.el7.noarch                                                                                       16/30
  Verifying  : 4:perl-Time-HiRes-1.9725-3.el7.x86_64                                                                               17/30
  Verifying  : perl-Scalar-List-Utils-1.27-248.el7.x86_64                                                                          18/30
  Verifying  : perl-Pod-Usage-1.63-3.el7.noarch                                                                                    19/30
  Verifying  : 2:vim-common-7.4.629-6.el7.x86_64                                                                                   20/30
  Verifying  : 2:vim-filesystem-7.4.629-6.el7.x86_64                                                                               21/30
  Verifying  : perl-Encode-2.51-7.el7.x86_64                                                                                       22/30
  Verifying  : perl-Pod-Perldoc-3.20-4.el7.noarch                                                                                  23/30
  Verifying  : perl-podlators-2.5.1-3.el7.noarch                                                                                   24/30
  Verifying  : perl-File-Path-2.09-2.el7.noarch                                                                                    25/30
  Verifying  : perl-threads-1.87-4.el7.x86_64                                                                                      26/30
  Verifying  : perl-Filter-1.49-3.el7.x86_64                                                                                       27/30
  Verifying  : perl-Getopt-Long-2.40-3.el7.noarch                                                                                  28/30
  Verifying  : perl-Text-ParseWords-3.29-4.el7.noarch                                                                              29/30
  Verifying  : perl-Socket-2.010-4.el7.x86_64                                                                                      30/30 
Installed:
  vim-enhanced.x86_64 2:7.4.629-6.el7

Dependency Installed:
  perl.x86_64 4:5.16.3-294.el7_6            perl-Carp.noarch 0:1.26-244.el7              perl-Encode.x86_64 0:2.51-7.el7
  perl-Exporter.noarch 0:5.68-3.el7         perl-File-Path.noarch 0:2.09-2.el7           perl-File-Temp.noarch 0:0.23.01-3.el7
  perl-Filter.x86_64 0:1.49-3.el7           perl-Getopt-Long.noarch 0:2.40-3.el7         perl-HTTP-Tiny.noarch 0:0.033-3.el7
  perl-PathTools.x86_64 0:3.40-5.el7        perl-Pod-Escapes.noarch 1:1.04-294.el7_6     perl-Pod-Perldoc.noarch 0:3.20-4.el7
  perl-Pod-Simple.noarch 1:3.28-4.el7       perl-Pod-Usage.noarch 0:1.63-3.el7           perl-Scalar-List-Utils.x86_64 0:1.27-248.el7
  perl-Socket.x86_64 0:2.010-4.el7          perl-Storable.x86_64 0:2.45-3.el7            perl-Text-ParseWords.noarch 0:3.29-4.el7
  perl-Time-HiRes.x86_64 4:1.9725-3.el7     perl-Time-Local.noarch 0:1.2300-2.el7        perl-constant.noarch 0:1.27-2.el7
  perl-libs.x86_64 4:5.16.3-294.el7_6       perl-macros.x86_64 4:5.16.3-294.el7_6        perl-parent.noarch 1:0.225-244.el7
  perl-podlators.noarch 0:2.5.1-3.el7       perl-threads.x86_64 0:1.87-4.el7             perl-threads-shared.x86_64 0:1.43-6.el7
  vim-common.x86_64 2:7.4.629-6.el7         vim-filesystem.x86_64 2:7.4.629-6.el7

Complete!
[root@localhost ~]#

Disable SELinux

 1
 2
 3
 4
 5
 6
 7
 8
 9
10

[root@localhost ~]# vim /etc/selinux/config
[root@localhost ~]# grep SELINUX /etc/selinux/config
# SELINUX= can take one of these three values:
SELINUX=disabled
# SELINUXTYPE= can take one of three values:
SELINUXTYPE=targeted
[root@localhost ~]#
[root@localhost ~]# shutdown -r now
Connection to worker2 closed by remote host.
Connection to worker2 closed.
Need to reboot for these change to take effect 
1
2
3
4
5

[root@localhost ~]# uptime
14:48:09 up 0 min,  1 user,  load average: 0.07, 0.03, 0.01
[root@localhost ~]# getenforce
  Disabled
[root@localhost ~]#

Add my preferred user
1
2
3
4
5
6
7

[root@localhost ~]# adduser ramon.gonzalez
[root@localhost ~]# passwd ramon.gonzalez
Changing password for user ramon.gonzalez.
New password:
Retype new password:
passwd: all authentication tokens updated successfully.
[root@localhost ~]#
Add sudo permission to my user
 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14

[root@localhost ~]# visudo
[root@localhost ~]# su ramon.gonzalez
[ramon.gonzalez@localhost root]$ sudo echo "turd"

We trust you have received the usual lecture from the local System
Administrator. It usually boils down to these three things:

    #1) Respect the privacy of others.
    #2) Think before you type.
    #3) With great power comes great responsibility.

[sudo] password for ramon.gonzalez:
turd
[ramon.gonzalez@localhost root]$
Install docker

Using the instructions from docker itself. Adding some needed tools: 

  1
  2
  3
  4
  5
  6
  7
  8
  9
 10
 11
 12
 13
 14
 15
 16
 17
 18
 19
 20
 21
 22
 23
 24
 25
 26
 27
 28
 29
 30
 31
 32
 33
 34
 35
 36
 37
 38
 39
 40
 41
 42
 43
 44
 45
 46
 47
 48
 49
 50
 51
 52
 53
 54
 55
 56
 57
 58
 59
 60
 61
 62
 63
 64
 65
 66
 67
 68
 69
 70
 71
 72
 73
 74
 75
 76
 77
 78
 79
 80
 81
 82
 83
 84
 85
 86
 87
 88
 89
 90
 91
 92
 93
 94
 95
 96
 97
 98
 99
100
101
102
103
104
105
106
107
108

[root@localhost ~]# yum install -y yum-utils device-mapper-persistent-data lvm2
Failed to set locale, defaulting to C
Loaded plugins: fastestmirror
Loading mirror speeds from cached hostfile
 * base: mirror.math.princeton.edu
 * extras: mirror.math.princeton.edu
 * updates: mirror.math.princeton.edu
Package yum-utils-1.1.31-52.el7.noarch already installed and latest version
Resolving Dependencies
--> Running transaction check
---> Package device-mapper-persistent-data.x86_64 0:0.7.3-3.el7 will be updated
---> Package device-mapper-persistent-data.x86_64 0:0.8.5-1.el7 will be an update
---> Package lvm2.x86_64 7:2.02.180-8.el7 will be updated
---> Package lvm2.x86_64 7:2.02.185-2.el7 will be an update
--> Processing Dependency: lvm2-libs = 7:2.02.185-2.el7 for package: 7:lvm2-2.02.185-2.el7.x86_64
--> Running transaction check
---> Package lvm2-libs.x86_64 7:2.02.180-8.el7 will be updated
---> Package lvm2-libs.x86_64 7:2.02.185-2.el7 will be an update
--> Processing Dependency: device-mapper-event = 7:1.02.158-2.el7 for package: 7:lvm2-libs-2.02.185-2.el7.x86_64
--> Running transaction check
---> Package device-mapper-event.x86_64 7:1.02.149-8.el7 will be updated
---> Package device-mapper-event.x86_64 7:1.02.158-2.el7 will be an update
--> Processing Dependency: device-mapper-event-libs = 7:1.02.158-2.el7 for package: 7:device-mapper-event-1.02.158-2.el7.x86_64
--> Processing Dependency: device-mapper = 7:1.02.158-2.el7 for package: 7:device-mapper-event-1.02.158-2.el7.x86_64
--> Running transaction check
---> Package device-mapper.x86_64 7:1.02.149-8.el7 will be updated
--> Processing Dependency: device-mapper = 7:1.02.149-8.el7 for package: 7:device-mapper-libs-1.02.149-8.el7.x86_64
---> Package device-mapper.x86_64 7:1.02.158-2.el7 will be an update
---> Package device-mapper-event-libs.x86_64 7:1.02.149-8.el7 will be updated
---> Package device-mapper-event-libs.x86_64 7:1.02.158-2.el7 will be an update
--> Running transaction check
---> Package device-mapper-libs.x86_64 7:1.02.149-8.el7 will be updated
---> Package device-mapper-libs.x86_64 7:1.02.158-2.el7 will be an update
--> Finished Dependency Resolution

Dependencies Resolved

=========================================================================================================================================
Package                                        Arch                    Version                              Repository             Size
=========================================================================================================================================
Updating:
 device-mapper-persistent-data                  x86_64                  0.8.5-1.el7                          base                  423 k
 lvm2                                           x86_64                  7:2.02.185-2.el7                     base                  1.3 M
 Updating for dependencies:
 device-mapper                                  x86_64                  7:1.02.158-2.el7                     base                  294 k
 device-mapper-event                            x86_64                  7:1.02.158-2.el7                     base                  189 k
 device-mapper-event-libs                       x86_64                  7:1.02.158-2.el7                     base                  189 k
 device-mapper-libs                             x86_64                  7:1.02.158-2.el7                     base                  322 k
 lvm2-libs                                      x86_64                  7:2.02.185-2.el7                     base                  1.1 M
Transaction Summary
=========================================================================================================================================
Upgrade  2 Packages (+5 Dependent packages)

Total download size: 3.8 M
Downloading packages:
Delta RPMs disabled because /usr/bin/applydeltarpm not installed.
(1/7): device-mapper-event-1.02.158-2.el7.x86_64.rpm                                                              | 189 kB  00:00:00
(2/7): device-mapper-event-libs-1.02.158-2.el7.x86_64.rpm                                                         | 189 kB  00:00:00
(3/7): device-mapper-1.02.158-2.el7.x86_64.rpm                                                                    | 294 kB  00:00:00
(4/7): device-mapper-persistent-data-0.8.5-1.el7.x86_64.rpm                                                       | 423 kB  00:00:00
(5/7): device-mapper-libs-1.02.158-2.el7.x86_64.rpm                                                               | 322 kB  00:00:00
(6/7): lvm2-2.02.185-2.el7.x86_64.rpm                                                                             | 1.3 MB  00:00:00
(7/7): lvm2-libs-2.02.185-2.el7.x86_64.rpm                                                                        | 1.1 MB  00:00:00
-----------------------------------------------------------------------------------------------------------------------------------------
Total                                                                                                     12 MB/s | 3.8 MB  00:00:00
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
  Updating   : 7:device-mapper-libs-1.02.158-2.el7.x86_64                                                                           1/14
  Updating   : 7:device-mapper-1.02.158-2.el7.x86_64                                                                                2/14
  Updating   : 7:device-mapper-event-libs-1.02.158-2.el7.x86_64                                                                     3/14
  Updating   : 7:device-mapper-event-1.02.158-2.el7.x86_64                                                                          4/14
  Updating   : 7:lvm2-libs-2.02.185-2.el7.x86_64                                                                                    5/14
  Updating   : device-mapper-persistent-data-0.8.5-1.el7.x86_64                                                                     6/14
  Updating   : 7:lvm2-2.02.185-2.el7.x86_64                                                                                         7/14
  Cleanup    : 7:lvm2-2.02.180-8.el7.x86_64                                                                                         8/14
  Cleanup    : 7:lvm2-libs-2.02.180-8.el7.x86_64                                                                                    9/14
  Cleanup    : 7:device-mapper-event-1.02.149-8.el7.x86_64                                                                         10/14
  Cleanup    : 7:device-mapper-event-libs-1.02.149-8.el7.x86_64                                                                    11/14
  Cleanup    : 7:device-mapper-1.02.149-8.el7.x86_64                                                                               12/14
  Cleanup    : 7:device-mapper-libs-1.02.149-8.el7.x86_64                                                                          13/14
  Cleanup    : device-mapper-persistent-data-0.7.3-3.el7.x86_64                                                                    14/14
  Verifying  : 7:device-mapper-event-1.02.158-2.el7.x86_64                                                                          1/14
  Verifying  : device-mapper-persistent-data-0.8.5-1.el7.x86_64                                                                     2/14
  Verifying  : 7:device-mapper-event-libs-1.02.158-2.el7.x86_64                                                                     3/14
  Verifying  : 7:device-mapper-1.02.158-2.el7.x86_64                                                                                4/14
  Verifying  : 7:device-mapper-libs-1.02.158-2.el7.x86_64                                                                           5/14
  Verifying  : 7:lvm2-libs-2.02.185-2.el7.x86_64                                                                                    6/14
  Verifying  : 7:lvm2-2.02.185-2.el7.x86_64                                                                                         7/14
  Verifying  : device-mapper-persistent-data-0.7.3-3.el7.x86_64                                                                     8/14
  Verifying  : 7:lvm2-2.02.180-8.el7.x86_64                                                                                         9/14
  Verifying  : 7:device-mapper-event-1.02.149-8.el7.x86_64                                                                         10/14
  Verifying  : 7:lvm2-libs-2.02.180-8.el7.x86_64                                                                                   11/14
  Verifying  : 7:device-mapper-1.02.149-8.el7.x86_64                                                                               12/14
  Verifying  : 7:device-mapper-event-libs-1.02.149-8.el7.x86_64                                                                    13/14
  Verifying  : 7:device-mapper-libs-1.02.149-8.el7.x86_64                                                                          14/14

Updated:
  device-mapper-persistent-data.x86_64 0:0.8.5-1.el7                             lvm2.x86_64 7:2.02.185-2.el7

Dependency Updated:
  device-mapper.x86_64 7:1.02.158-2.el7                                 device-mapper-event.x86_64 7:1.02.158-2.el7
  device-mapper-event-libs.x86_64 7:1.02.158-2.el7                      device-mapper-libs.x86_64 7:1.02.158-2.el7
  lvm2-libs.x86_64 7:2.02.185-2.el7

Complete!
[root@localhost ~]#

Adding the docker repo 

1
2
3
4
5
6
7

[root@localhost ~]# sudo yum-config-manager --add-repo https://download.docker.com/linux/centos/docker-ce.repo
Failed to set locale, defaulting to C
Loaded plugins: fastestmirror
adding repo from: https://download.docker.com/linux/centos/docker-ce.repo
grabbing file https://download.docker.com/linux/centos/docker-ce.repo to /etc/yum.repos.d/docker-ce.repo
repo saved to /etc/yum.repos.d/docker-ce.repo
[root@localhost ~]#

Install docker 

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74

[root@localhost ~]# yum install docker-ce
Failed to set locale, defaulting to C
Loaded plugins: fastestmirror
Loading mirror speeds from cached hostfile
 * base: mirror.math.princeton.edu
 * extras: mirror.math.princeton.edu
 * updates: mirror.math.princeton.edu
docker-ce-stable                                                                                                  | 3.5 kB  00:00:00
(1/2): docker-ce-stable/x86_64/updateinfo                                                                         |   55 B  00:00:00
(2/2): docker-ce-stable/x86_64/primary_db                                                                         |  37 kB  00:00:00
Resolving Dependencies
--> Running transaction check
---> Package docker-ce.x86_64 3:19.03.4-3.el7 will be installed
--> Processing Dependency: container-selinux >= 2:2.74 for package: 3:docker-ce-19.03.4-3.el7.x86_64
--> Processing Dependency: containerd.io >= 1.2.2-3 for package: 3:docker-ce-19.03.4-3.el7.x86_64
--> Processing Dependency: docker-ce-cli for package: 3:docker-ce-19.03.4-3.el7.x86_64
--> Running transaction check
---> Package container-selinux.noarch 2:2.107-3.el7 will be installed
---> Package containerd.io.x86_64 0:1.2.10-3.2.el7 will be installed
---> Package docker-ce-cli.x86_64 1:19.03.4-3.el7 will be installed
--> Finished Dependency Resolution

Dependencies Resolved

=========================================================================================================================================
Package                             Arch                     Version                           Repository                          Size
=========================================================================================================================================
Installing:
 docker-ce                           x86_64                   3:19.03.4-3.el7                   docker-ce-stable                    24 M
 Installing for dependencies:
 container-selinux                   noarch                   2:2.107-3.el7                     extras                              39 k
 containerd.io                       x86_64                   1.2.10-3.2.el7                    docker-ce-stable                    23 M
 docker-ce-cli                       x86_64                   1:19.03.4-3.el7                   docker-ce-stable                    39 M

Transaction Summary
=========================================================================================================================================Install  1 Package (+3 Dependent packages)

Total download size: 87 M
Installed size: 362 M
Is this ok [y/d/N]: y
Downloading packages:
(1/4): container-selinux-2.107-3.el7.noarch.rpm                                                                   |  39 kB  00:00:00
warning: /var/cache/yum/x86_64/7/docker-ce-stable/packages/containerd.io-1.2.10-3.2.el7.x86_64.rpm: Header V4 RSA/SHA512 Signature, key ID 621e9f35: NOKEY Public key for containerd.io-1.2.10-3.2.el7.x86_64.rpm is not installed
(2/4): containerd.io-1.2.10-3.2.el7.x86_64.rpm                                                                    |  23 MB  00:00:00
(3/4): docker-ce-19.03.4-3.el7.x86_64.rpm                                                                         |  24 MB  00:00:00
(4/4): docker-ce-cli-19.03.4-3.el7.x86_64.rpm                                                                     |  39 MB  00:00:00
-----------------------------------------------------------------------------------------------------------------------------------------
Total                                                                                                     72 MB/s |  87 MB  00:00:01
Retrieving key from https://download.docker.com/linux/centos/gpg
Importing GPG key 0x621E9F35:
 Userid     : "Docker Release (CE rpm) <docker@docker.com>"
 Fingerprint: 060a 61c5 1b55 8a7f 742b 77aa c52f eb6b 621e 9f35
 From       : https://download.docker.com/linux/centos/gpg
Is this ok [y/N]: y
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
  Installing : 2:container-selinux-2.107-3.el7.noarch                                                                                1/4:  SELinux is disabled.
  Installing : containerd.io-1.2.10-3.2.el7.x86_64                                                                                   2/4
  Installing : 1:docker-ce-cli-19.03.4-3.el7.x86_64                                                                                  3/4
  Installing : 3:docker-ce-19.03.4-3.el7.x86_64                                                                                      4/4
  Verifying  : 1:docker-ce-cli-19.03.4-3.el7.x86_64                                                                                  1/4
  Verifying  : 3:docker-ce-19.03.4-3.el7.x86_64                                                                                      2/4
  Verifying  : containerd.io-1.2.10-3.2.el7.x86_64                                                                                   3/4
  Verifying  : 2:container-selinux-2.107-3.el7.noarch                                                                                4/4

Installed:
  docker-ce.x86_64 3:19.03.4-3.el7

Dependency Installed:
  container-selinux.noarch 2:2.107-3.el7        containerd.io.x86_64 0:1.2.10-3.2.el7        docker-ce-cli.x86_64 1:19.03.4-3.el7
Complete!
[root@localhost ~]#

Finally I would add my ssh-key to the newly built host: 

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17

rjgonza@WinRoy:~$ ssh worker2
Enter passphrase for key '/home/rjgonza/.ssh/id_rsa':

rjgonza@WinRoy:~$ ssh-copy-id worker2
/usr/bin/ssh-copy-id: INFO: attempting to log in with the new key(s), to filter out any that are already installed
/usr/bin/ssh-copy-id: INFO: 1 key(s) remain to be installed -- if you are prompted now it is to install the new keys
Enter passphrase for key '/home/rjgonza/.ssh/id_rsa':
ramon.gonzalez@worker2's password:
Permission denied, please try again.
ramon.gonzalez@worker2's password:

Number of key(s) added: 1

Now try logging into the machine, with:"ssh 'worker2'"
and check to make sure that only the key(s) you wanted were added.

rjgonza@WinRoy:~$

Disable firewall
1
2
3
4
5

[root@worker2 ~]# systemctl stop firewalld
[root@worker2 ~]# systemctl disable firewalld
Removed symlink /etc/systemd/system/multi-user.target.wants/firewalld.service.
Removed symlink /etc/systemd/system/dbus-org.fedoraproject.FirewallD1.service.
[root@worker2 ~]#

Automated

Move Newly built Worker Into Physical Location

Manual

I just carried the little guy over there: worker2

Automated

Add Docker Socket On the New Worker to the Current Portainer Instance

Manual

Now I just head over to portainer and added a new docker API endpoint and done. portainer

Automated

In the next couple posts I will go over automating these steps and then try it all out on worker3.

]]> Forgot my Portainer Password https://rjgonza.com/posts/2019/10/forgot-my-portainer-password/ Sun, 13 Oct 2019 20:37:07 -0400 https://rjgonza.com/posts/2019/10/forgot-my-portainer-password/ Quick Background I use a portainer setup for my home lab. I have 3 different Intel NUCs that make up my workers. They are all running an instance of docker and portainer. While setting up this blog I was looking to see if I could improve this setup a bit or at least upgrade to the latest version (this has been running for 6+ months now). When I fired up my browser and targeted my portainer instance I was greeted with an unfamiliar authentication page. Quick Background

I use a portainer setup for my home lab. I have 3 different Intel NUCs that make up my workers. They are all running an instance of docker and portainer. While setting up this blog I was looking to see if I could improve this setup a bit or at least upgrade to the latest version (this has been running for 6+ months now). When I fired up my browser and targeted my portainer instance I was greeted with an unfamiliar authentication page.

Head Over to Google

I began by searching around for anyone with a similar issue. This ultimately led me to an open issue on github. Seeing that green open button made me think about blowing away the portainer db and starting over, but then I cam across this comment: github savior

At this point I just shutdown my container, edited the file by pasting in my new password hash and done!

Create new password hash (taking everything after the :): 

[root@worker1 _data]# docker run --rm httpd:2.4-alpine htpasswd -nbB admin 'turd'
admin:$2y$05$c7YabuHwYNFboeXU/qrS6u4j9H6D0q6c6ebj9X2bMe/o9vGbYi0uu

[root@worker1 _data]#

Stop, edit, restart: 

[root@worker1 ~]# docker stop 2946f43374f2
2946f43374f2
[root@worker1 ~]#
[root@worker1 _data]# /tmp/boltbrowser
Usage: boltbrowser [OPTIONS] <filename(s)>
Options:
  -timeout=duration
  DB file open timeout (default 1s)
  -ro, -readonly
  Open the DB in read-only mode
[root@worker1 _data]# /tmp/boltbrowser portainer.db
[root@worker1 _data]# docker start 2946f43374f2
2946f43374f2
[root@worker1 _data]#

boltbrowser view: boltdb

]]>