Cryptograss:Maybelle/deploy logs/26195438

From PickiPedia: A knowledge base of bluegrass, old time psychedelic jams, and other public domain music
Revision as of 04:11, 15 October 2026 by DrivingThatTrain (talk | contribs) (maybelle failed: deploy log)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigationJump to search

✗ maybelle redeploy failed at block 26,195,438 (2026-10-15 04:11 UTC), in 1m 36s, by JMyles, maybelle-config f71e8bee2a20.

Posted by DrivingThatTrain. Taken out before posting: 0 vault values, by exact match, and 0 secret-shaped strings.

Where it stopped

  • Run Django migrations
fatal: [localhost]: FAILED! => {"changed": true, "cmd": ["docker", "exec", "memory-lane", "python", "manage.py", "migrate", "--noinput"], "delta": "0:00:01.763374", "end": "2026-10-15 04:11:44.764581", "msg": "non-zero return code", "rc": 1, "start": "2026-10-15 04:11:43.001207", "stderr": "CommandError: Conflicting migrations detected; multiple leaf nodes in the migration graph: (0023_task_notices_are_not_people, 0024_re in conversations).\nTo fix them run 'python manage.py makemigrations --merge'", "stderr_lines": ["CommandError: Conflicting migrations detected; multiple leaf nodes in the mi

The whole log

PLAY [Provision Jenkins for Cryptograss] ***************************************

TASK [Gathering Facts] *********************************************************
ok: [localhost]

TASK [Install community.docker collection] *************************************
ok: [localhost]

TASK [Say in magenta who comes in by SSH, and as which account] ****************

TASK [ssh-announce : Create /etc/magenta and /usr/local/lib/magenta] ***********
ok: [localhost] => (item=/etc/magenta)
ok: [localhost] => (item=/usr/local/lib/magenta)

TASK [ssh-announce : Install the script that tells magenta] ********************
ok: [localhost]

TASK [ssh-announce : Install the login hook] ***********************************
ok: [localhost]

TASK [ssh-announce : Write whose each key is] **********************************
ok: [localhost]

TASK [ssh-announce : Give it magenta's access key] *****************************
ok: [localhost]

TASK [ssh-announce : No access key in the vault, so no announcing] *************
skipping: [localhost]

TASK [ssh-announce : Run the hook as each SSH session opens] *******************
ok: [localhost]

TASK [Deploy maybelle SSH login banner] ****************************************
ok: [localhost]

TASK [Install required packages] ***********************************************
ok: [localhost]

TASK [Create Jenkins home directory] *******************************************
ok: [localhost]

TASK [Copy environment file] ***************************************************
ok: [localhost]

TASK [Create Jenkins Docker build directory] ***********************************
ok: [localhost]

TASK [Copy Dockerfile and build context] ***************************************
ok: [localhost]

TASK [Create blank .bashrc] ****************************************************
changed: [localhost]

TASK [Build Jenkins Docker image] **********************************************
ok: [localhost]

TASK [Create Jenkins Casc Configs directory] ***********************************
ok: [localhost]

TASK [Create Jenkins Docker network] *******************************************
ok: [localhost]

TASK [Copy Jenkins configuration file] *****************************************
ok: [localhost]

TASK [Create Jenkins jobs directory] *******************************************
ok: [localhost]

TASK [Copy Jenkins job definitions] ********************************************
ok: [localhost]

TASK [Create Jenkins scripts directory] ****************************************
ok: [localhost]

TASK [Copy health-check scripts into Jenkins] **********************************
ok: [localhost] => (item=/mnt/HC_Volume_104062902/maybelle-config/maybelle/ansible/../scripts/test-magenta-memory.py)
ok: [localhost] => (item=/mnt/HC_Volume_104062902/maybelle-config/maybelle/ansible/../../delivery-kid/scripts/test-delivery-kid.py)

TASK [Remove retired Jenkins job-DSL files] ************************************
ok: [localhost] => (item=arthel-rsync-status.groovy)
ok: [localhost] => (item=pickipedia-rsync-status.groovy)
ok: [localhost] => (item=backup-pickipedia.groovy)
ok: [localhost] => (item=backup-memory-lane.groovy)
ok: [localhost] => (item=pickipedia-enrich-torrents.groovy)

TASK [Remove retired Jenkins job runtime directories] **************************
ok: [localhost] => (item=arthel-rsync-status)
ok: [localhost] => (item=pickipedia-rsync-status)
ok: [localhost] => (item=backup-pickipedia)
ok: [localhost] => (item=backup-memory-lane)
ok: [localhost] => (item=pickipedia-enrich-torrents)

TASK [Check if log paths are directories (Docker creates dirs for missing mount sources)] ***
ok: [localhost] => (item=/var/log/nfs-backup.log)
ok: [localhost] => (item=/var/log/nfs-deploy.log)
ok: [localhost] => (item=/var/log/pickipedia-backup.log)
ok: [localhost] => (item=/var/log/pickipedia-deploy.log)

TASK [Remove log paths if they are directories] ********************************
skipping: [localhost] => (item={'changed': False, 'stat': {'exists': True, 'path': '/var/log/nfs-backup.log', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 73703, 'inode': 215, 'dev': 2049, 'nlink': 1, 'atime': 1792036660.2625823, 'mtime': 1792036803.0585067, 'ctime': 1792036803.0585067, 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False, 'blocks': 152, 'block_size': 4096, 'device_type': 0, 'readable': True, 'writeable': True, 'executable': False, 'pw_name': 'root', 'gr_name': 'root', 'checksum': '2076e03884dfe45e9e15396f92fe63372400dc7c', 'mimetype': 'unknown', 'charset': 'unknown', 'version': '815275292', 'attributes': ['extents'], 'attr_flags': 'e'}, 'invocation': {'module_args': {'path': '/var/log/nfs-backup.log', 'follow': False, 'get_checksum': True, 'get_mime': True, 'get_attributes': True, 'checksum_algorithm': 'sha1'}}, 'failed': False, 'item': '/var/log/nfs-backup.log', 'ansible_loop_var': 'item'}) 
skipping: [localhost] => (item={'changed': False, 'stat': {'exists': True, 'path': '/var/log/nfs-deploy.log', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 2723780831, 'inode': 1245, 'dev': 2049, 'nlink': 1, 'atime': 1792036660.5525842, 'mtime': 1792037409.1398976, 'ctime': 1792037409.1398976, 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False, 'blocks': 5323264, 'block_size': 4096, 'device_type': 0, 'readable': True, 'writeable': True, 'executable': False, 'pw_name': 'root', 'gr_name': 'root', 'checksum': '8a9436e0a7307a81824c2054dca90122cedfde92', 'mimetype': 'unknown', 'charset': 'unknown', 'version': '2795823190', 'attributes': ['extents'], 'attr_flags': 'e'}, 'invocation': {'module_args': {'path': '/var/log/nfs-deploy.log', 'follow': False, 'get_checksum': True, 'get_mime': True, 'get_attributes': True, 'checksum_algorithm': 'sha1'}}, 'failed': False, 'item': '/var/log/nfs-deploy.log', 'ansible_loop_var': 'item'}) 
skipping: [localhost] => (item={'changed': False, 'stat': {'exists': True, 'path': '/var/log/pickipedia-backup.log', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 854715, 'inode': 1846, 'dev': 2049, 'nlink': 1, 'atime': 1792036723.8509936, 'mtime': 1792036723.8509936, 'ctime': 1792036723.8509936, 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False, 'blocks': 1680, 'block_size': 4096, 'device_type': 0, 'readable': True, 'writeable': True, 'executable': False, 'pw_name': 'root', 'gr_name': 'root', 'checksum': '4a076f970a6419719d5bd5910fce3feef08c19f5', 'mimetype': 'unknown', 'charset': 'unknown', 'version': '873719913', 'attributes': ['extents'], 'attr_flags': 'e'}, 'invocation': {'module_args': {'path': '/var/log/pickipedia-backup.log', 'follow': False, 'get_checksum': True, 'get_mime': True, 'get_attributes': True, 'checksum_algorithm': 'sha1'}}, 'failed': False, 'item': '/var/log/pickipedia-backup.log', 'ansible_loop_var': 'item'}) 
skipping: [localhost] => (item={'changed': False, 'stat': {'exists': True, 'path': '/var/log/pickipedia-deploy.log', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 0, 'gid': 0, 'size': 8528985650, 'inode': 2910, 'dev': 2049, 'nlink': 1, 'atime': 1792036661.0715876, 'mtime': 1792037401.2918622, 'ctime': 1792037401.2918622, 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False, 'blocks': 16659560, 'block_size': 4096, 'device_type': 0, 'readable': True, 'writeable': True, 'executable': False, 'pw_name': 'root', 'gr_name': 'root', 'checksum': '0b15b8fde520cecd02f0566ef1dd2614bbf82b95', 'mimetype': 'unknown', 'charset': 'unknown', 'version': '1261557222', 'attributes': ['extents'], 'attr_flags': 'e'}, 'invocation': {'module_args': {'path': '/var/log/pickipedia-deploy.log', 'follow': False, 'get_checksum': True, 'get_mime': True, 'get_attributes': True, 'checksum_algorithm': 'sha1'}}, 'failed': False, 'item': '/var/log/pickipedia-deploy.log', 'ansible_loop_var': 'item'}) 
skipping: [localhost]

TASK [Create log files for Jenkins to read] ************************************
changed: [localhost] => (item=/var/log/nfs-backup.log)
changed: [localhost] => (item=/var/log/nfs-deploy.log)
changed: [localhost] => (item=/var/log/pickipedia-backup.log)
changed: [localhost] => (item=/var/log/pickipedia-deploy.log)

TASK [Start Jenkins container] *************************************************
ok: [localhost]

TASK [Apply pending Jenkins restart before docker-exec tasks] ******************

TASK [Inspect Jenkins container state] *****************************************
ok: [localhost]

TASK [Force-restart Jenkins if not running cleanly] ****************************
skipping: [localhost]

TASK [Wait for Jenkins container to accept docker exec] ************************
ok: [localhost]

TASK [Clone or update blue-railroad-import source] *****************************
changed: [localhost]

TASK [Install blue-railroad-import from local checkout] ************************
changed: [localhost]

TASK [Fix blue-railroad-cache permissions] *************************************
changed: [localhost]

TASK [Hash GlitchTip DSN fetch password for Caddy basicauth] *******************
ok: [localhost]

TASK [Set GlitchTip DSN fetch password hash variable] **************************
ok: [localhost]

TASK [Configure Caddy reverse proxy] *******************************************

TASK [caddy : Install Caddy (from Ubuntu universe repository)] *****************
ok: [localhost]

TASK [caddy : Create Caddy config directory] ***********************************
ok: [localhost]

TASK [caddy : Deploy Caddyfile] ************************************************
changed: [localhost]

TASK [caddy : Enable and restart Caddy to load config] *************************
changed: [localhost]

TASK [Create .ssh directory for root] ******************************************
ok: [localhost]

TASK [Deploy NFS SSH key from vault] *******************************************
ok: [localhost]

TASK [Deploy Jenkins reporter password for deploy scripts] *********************
ok: [localhost]

TASK [Deploy memory-lane deploy key for the deploy scripts] ********************
ok: [localhost]

TASK [Create .ssh directory for jenkins user] **********************************
ok: [localhost]

TASK [Generate backup SSH key for hunter access] *******************************
ok: [localhost]

TASK [Deploy Jenkins GitHub SSH key from vault] ********************************
ok: [localhost]

TASK [Deploy hunter root SSH key from vault] ***********************************
ok: [localhost]

TASK [Configure SSH for hunter, NFS, and delivery-kid] *************************
changed: [localhost]

TASK [Add hunter to known_hosts] ***********************************************
changed: [localhost]

TASK [Add delivery-kid to root known_hosts] ************************************
ok: [localhost]

TASK [Ensure that known_hosts is present] **************************************
changed: [localhost]

TASK [Remove stale NFS host key from root known_hosts] *************************
changed: [localhost]

TASK [Add current NFS host key to root known_hosts] ****************************
changed: [localhost]

TASK [Add known_hosts entry for github.com] ************************************
changed: [localhost]

TASK [Add hunter to jenkins user known_hosts] **********************************
changed: [localhost]

TASK [Fix ownership of jenkins known_hosts] ************************************
ok: [localhost]

TASK [Create production deploy script] *****************************************
ok: [localhost]

TASK [Cronjob to deploy production builds to NFS] ******************************
ok: [localhost]

TASK [Create PickiPedia production deploy script] ******************************
ok: [localhost]

TASK [Remove old NFS deploy cron] **********************************************
ok: [localhost]

TASK [Cronjob to deploy PickiPedia production builds to VPS] *******************
ok: [localhost]

TASK [Remove old rsync cron if exists] *****************************************
ok: [localhost]

TASK [Create venv and install python deps for delivery-kid audit] **************
ok: [localhost]

TASK [Create delivery-kid audit state directory] *******************************
ok: [localhost]

TASK [Deploy delivery-kid audit env file (bot credentials)] ********************
ok: [localhost]

TASK [Create delivery-kid audit runner script] *********************************
ok: [localhost]

TASK [Ensure delivery-kid audit log file exists] *******************************
ok: [localhost]

TASK [Cronjob for delivery-kid audit (every 30 minutes)] ***********************
ok: [localhost]

TASK [Create Jenkins casc_configs/jobs directory] ******************************
ok: [localhost]

TASK [Create Jenkins secrets directory] ****************************************
ok: [localhost]

TASK [Deploy justinholmes.com .env file from vault] ****************************
ok: [localhost]

TASK [Create PickiPedia secrets directory] *************************************
changed: [localhost]

TASK [Deploy msmtp configuration for email alerts] *****************************
skipping: [localhost]

TASK [Deploy PickiPedia LocalSettings.local.php from vault] ********************
changed: [localhost]

TASK [Create PR builds directory] **********************************************
ok: [localhost]

TASK [Create magenta directories on persistent volume] *************************
ok: [localhost] => (item=/mnt/persist/magenta)
ok: [localhost] => (item=/mnt/persist/magenta/backups)

TASK [Clone or update memory-lane repository] **********************************
changed: [localhost]

TASK [Create Memory Lane .env file] ********************************************
ok: [localhost]

TASK [Create docker network for memory lane] ***********************************
ok: [localhost]

TASK [Include postgres role] ***************************************************

TASK [postgres : Create PostgreSQL data directory] *****************************
ok: [localhost]

TASK [postgres : Create PostgreSQL docker-compose file] ************************
ok: [localhost]

TASK [postgres : Start PostgreSQL container] ***********************************
changed: [localhost]

TASK [Write Moods allowed_signers] *********************************************
ok: [localhost]

TASK [Write Moods wiki_names] **************************************************
ok: [localhost]

TASK [Create Memory Lane docker-compose file] **********************************
ok: [localhost]

TASK [Start Memory Lane services] **********************************************
[WARNING]: Cannot parse event from line: 'time="2026-10-15T04:11:34Z"
level=warning msg="The \\"ae6RN9f\\" variable is not set. Defaulting to a blank
string."'. Please report this at https://github.com/ansible-collections/communi
ty.docker/issues/new?assignees=&labels=&projects=&template=bug_report.md
[WARNING]: Cannot parse event from line: 'scrubber  Built'. Please report this
at https://github.com/ansible-collections/community.docker/issues/new?assignees
=&labels=&projects=&template=bug_report.md
[WARNING]: Cannot parse event from line: 'memory-lane  Built'. Please report
this at https://github.com/ansible-collections/community.docker/issues/new?assi
gnees=&labels=&projects=&template=bug_report.md
[WARNING]: Cannot parse event from line: 'mcp-server  Built'. Please report
this at https://github.com/ansible-collections/community.docker/issues/new?assi
gnees=&labels=&projects=&template=bug_report.md
changed: [localhost]

TASK [Check if scrubber secrets temp file exists] ******************************
ok: [localhost]

TASK [Copy secrets into scrubber container] ************************************
changed: [localhost]

TASK [Fix secrets file ownership in container] *********************************
changed: [localhost]

TASK [Remove temp secrets file] ************************************************
changed: [localhost]

TASK [Restart scrubber to load secrets] ****************************************
changed: [localhost]

TASK [Wait for postgres to be ready] *******************************************
changed: [localhost]

TASK [Run Django migrations] ***************************************************
fatal: [localhost]: FAILED! => {"changed": true, "cmd": ["docker", "exec", "memory-lane", "python", "manage.py", "migrate", "--noinput"], "delta": "0:00:01.763374", "end": "2026-10-15 04:11:44.764581", "msg": "non-zero return code", "rc": 1, "start": "2026-10-15 04:11:43.001207", "stderr": "CommandError: Conflicting migrations detected; multiple leaf nodes in the migration graph: (0023_task_notices_are_not_people, 0024_re in conversations).\nTo fix them run 'python manage.py makemigrations --merge'", "stderr_lines": ["CommandError: Conflicting migrations detected; multiple leaf nodes in the migration graph: (0023_task_notices_are_not_people, 0024_re in conversations).", "To fix them run 'python manage.py makemigrations --merge'"], "stdout": "", "stdout_lines": []}

PLAY RECAP *********************************************************************
localhost                  : ok=91   changed=24   unreachable=0    failed=1    skipped=4    rescued=0    ignored=0