https://projects.osmocom.org/https://projects.osmocom.org/favicon.ico?16647414092020-05-25T07:16:44ZOpen Source Mobile CommunicationsCellular Network Infrastructure - Feature #4563: install test for centos packages (like the debian install test)https://projects.osmocom.org/issues/4563?journal_id=184132020-05-25T07:16:44Zosmith
<ul><li><strong>Related to</strong> <i><a class="issue tracker-1 status-3 priority-3 priority-high3 closed parent" href="/issues/3176">Bug #3176</a>: osmocom debian packages are not install / upgrade tested</i> added</li></ul> Cellular Network Infrastructure - Feature #4563: install test for centos packages (like the debian install test)https://projects.osmocom.org/issues/4563?journal_id=184152020-05-25T07:17:21Zosmith
<ul><li><strong>Related to</strong> <i><a class="issue tracker-1 status-3 priority-2 priority-default closed" href="/issues/3369">Bug #3369</a>: no automatic testing of Debian/Ubuntu packages</i> added</li></ul> Cellular Network Infrastructure - Feature #4563: install test for centos packages (like the debian install test)https://projects.osmocom.org/issues/4563?journal_id=184172020-05-25T07:17:27Zosmith
<ul><li><strong>Related to</strong> <i><a class="issue tracker-2 status-3 priority-3 priority-high3 closed" href="/issues/4550">Feature #4550</a>: Integrate RPM spec files into Osmocom repositories and build them on OBS</i> added</li></ul> Cellular Network Infrastructure - Feature #4563: install test for centos packages (like the debian install test)https://projects.osmocom.org/issues/4563?journal_id=184292020-05-26T12:27:54Zosmith
<ul></ul>Concept:
<ul>
<li>move scripts that install all packages and try to run the services from docker-playground.git to osmo-ci.git. In docker-playground.git, we only have scripts for one image (nothing shared), so it fits better in osmo-ci.git</li>
<li>create a new image centos-repo-install-test in docker-playground.git</li>
<li>in osmo-ci.git:
<ul>
<li>trigger building the images from docker-playground.git (there's already code for that)</li>
<li>mount the shared script dir inside the containers</li>
<li>run the scripts in the containers, with a distro parameter to do distro specific installation etc.</li>
</ul>
</li>
<li>adjust jenkins job builder yml to make use of the new structure and run it for centos, too</li>
</ul> Cellular Network Infrastructure - Feature #4563: install test for centos packages (like the debian install test)https://projects.osmocom.org/issues/4563?journal_id=184302020-05-26T12:28:12Zosmith
<ul><li><strong>Status</strong> changed from <i>New</i> to <i>In Progress</i></li></ul> Cellular Network Infrastructure - Feature #4563: install test for centos packages (like the debian install test)https://projects.osmocom.org/issues/4563?journal_id=184392020-05-27T06:36:13Zosmith
<ul><li><strong>Tracker</strong> changed from <i>Bug</i> to <i>Feature</i></li></ul> Cellular Network Infrastructure - Feature #4563: install test for centos packages (like the debian install test)https://projects.osmocom.org/issues/4563?journal_id=184422020-05-27T10:41:40Zosmith
<ul><li><strong>% Done</strong> changed from <i>0</i> to <i>70</i></li></ul><p>Patches submitted:<br /><a class="external" href="https://gerrit.osmocom.org/q/topic:centos-install-test">https://gerrit.osmocom.org/q/topic:centos-install-test</a></p>
In jenkins:
<ul>
<li><a class="external" href="https://jenkins.osmocom.org/jenkins/job/Osmocom-repo-install-centos/">https://jenkins.osmocom.org/jenkins/job/Osmocom-repo-install-centos/</a></li>
<li><a class="external" href="https://jenkins.osmocom.org/jenkins/job/Osmocom-repo-install-debian/">https://jenkins.osmocom.org/jenkins/job/Osmocom-repo-install-debian/</a></li>
</ul>
<p>I just noticed that the workspace is not cleaned up properly yet:</p>
<blockquote>
<p>java.nio.file.FileSystemException: /home/osmocom-build/jenkins/workspace/Osmocom-repo-install-debian/feed/nightly/label/osmocom-master-debian9/_repo_install_test_data/blacklist.txt: Operation not permitted</p>
</blockquote>
<p>Furthermore, "Osmocom-repo-install-centos/feed=next" found a real error in the repository that needs to be fixed. This should not be problematic however, as it only occurs when installing osmo-trx-ipc and its debug symbols package (which AFAIK nobody is doing/trying at the moment):</p>
<blockquote>
<p>Error: Transaction check error:<br />file /usr/lib/debug/usr/bin/ipc-driver-test-1.2.0.60.bb89-2.1.x86_64.debug conflicts between attempted installs of osmo-trx-ipc-debuginfo-1.2.0.60.bb89-2.1.x86_64 and osmo-trx-ipc-1.2.0.60.bb89-2.1.x86_64</p>
</blockquote> Cellular Network Infrastructure - Feature #4563: install test for centos packages (like the debian install test)https://projects.osmocom.org/issues/4563?journal_id=184442020-05-27T12:07:20Zosmith
<ul></ul><p>osmith wrote:</p>
<blockquote>
<p>I just noticed that the workspace is not cleaned up properly yet:</p>
<blockquote>
<p>java.nio.file.FileSystemException: /home/osmocom-build/jenkins/workspace/Osmocom-repo-install-debian/feed/nightly/label/osmocom-master-debian9/_repo_install_test_data/blacklist.txt: Operation not permitted</p>
</blockquote>
</blockquote>
<p>Resolved with: <a class="external" href="https://gerrit.osmocom.org/c/osmo-ci/+/18518">https://gerrit.osmocom.org/c/osmo-ci/+/18518</a></p> Cellular Network Infrastructure - Feature #4563: install test for centos packages (like the debian install test)https://projects.osmocom.org/issues/4563?journal_id=184452020-05-27T12:22:23Zosmith
<ul><li><strong>% Done</strong> changed from <i>70</i> to <i>90</i></li></ul><p>osmith wrote:</p>
<blockquote>
<p>Furthermore, "Osmocom-repo-install-centos/feed=next" found a real error in the repository that needs to be fixed. This should not be problematic however, as it only occurs when installing osmo-trx-ipc and its debug symbols package (which AFAIK nobody is doing/trying at the moment):</p>
<blockquote>
<p>Error: Transaction check error:<br />file /usr/lib/debug/usr/bin/ipc-driver-test-1.2.0.60.bb89-2.1.x86_64.debug conflicts between attempted installs of osmo-trx-ipc-debuginfo-1.2.0.60.bb89-2.1.x86_64 and osmo-trx-ipc-1.2.0.60.bb89-2.1.x86_64</p>
</blockquote></blockquote>
<p>also fixed (in osmo-trx.git osmith/ipc branch, which is what the script for next is currently building).</p> Cellular Network Infrastructure - Feature #4563: install test for centos packages (like the debian install test)https://projects.osmocom.org/issues/4563?journal_id=184462020-05-27T13:02:56Zosmith
<ul></ul><p>rpm is failing on jenkins slave admin2-deb9build for some reason (is the machine broken?). But I can't look further into that now, I've configured the job to only run on build2-deb9build-ansible for now, this works fine.</p>
<pre>
error: rpmdb: BDB0060 PANIC: fatal region error detected; run recovery
error: db5 error(-30973) from db->close: BDB0087 DB_RUNRECOVERY: Fatal error, run database recovery
</pre>
<p><a class="external" href="https://jenkins.osmocom.org/jenkins/job/Osmocom-repo-install-centos/feed=next,label=osmocom-master-debian9/11/console">https://jenkins.osmocom.org/jenkins/job/Osmocom-repo-install-centos/feed=next,label=osmocom-master-debian9/11/console</a></p> Cellular Network Infrastructure - Feature #4563: install test for centos packages (like the debian install test)https://projects.osmocom.org/issues/4563?journal_id=184552020-05-28T07:20:15Zlaforge
<ul></ul><p>On Wed, May 27, 2020 at 01:02:57PM +0000, osmith [REDMINE] wrote:</p>
<blockquote>
<p>rpm is failing on jenkins slave admin2-deb9build for some reason (is the machine broken?).</p>
</blockquote>
<p>the machine is fine, it runs tons of other services. There is plenty of disk space, and no errors<br />in the kernel log or other suspicious behavior.</p>
I suggest:
<ul>
<li>rebuilding the docker container</li>
<li>restarting the deb9build lxc (can use "reboot" like a physical machine).</li>
</ul> Cellular Network Infrastructure - Feature #4563: install test for centos packages (like the debian install test)https://projects.osmocom.org/issues/4563?journal_id=184562020-05-28T10:13:13Zosmith
<ul><li><strong>Status</strong> changed from <i>In Progress</i> to <i>Resolved</i></li><li><strong>% Done</strong> changed from <i>90</i> to <i>100</i></li></ul><p>laforge wrote:</p>
<blockquote>
On Wed, May 27, 2020 at 01:02:57PM +0000, osmith [REDMINE] wrote:<br />I suggest:
<ul>
<li>rebuilding the docker container</li>
</ul>
</blockquote>
<p>I've tried this yesterday, same result.</p>
<blockquote>
<ul>
<li>restarting the deb9build lxc (can use "reboot" like a physical machine).</li>
</ul>
</blockquote>
<p>Debugging this now doesn't seem a good use of time, given that I also need to get the centos8 ttcn-3 implementation done. With the workaround of hardcoding a node, it is working now, and I'm certain that it is an issue with that specific jenkins node (admin2-deb9build).</p>
<p>I'll set this issue to resolved, as the centos packages install and systemd services test script is now rolled out.</p> Cellular Network Infrastructure - Feature #4563: install test for centos packages (like the debian install test)https://projects.osmocom.org/issues/4563?journal_id=184652020-05-28T21:28:54Zlaforge
<ul></ul><p>On Thu, May 28, 2020 at 10:13:13AM +0000, osmith [REDMINE] wrote:</p>
<blockquote>
<p>Debugging this now doesn't seem a good use of time, [...]<br />I'll set this issue to resolved, [...]</p>
</blockquote>
<p>Then please at least create a separate ticket about the bug, as otherwise we<br />lose all knowledge of it.</p> Cellular Network Infrastructure - Feature #4563: install test for centos packages (like the debian install test)https://projects.osmocom.org/issues/4563?journal_id=184662020-05-29T06:18:09Zosmith
<ul></ul><p>laforge wrote:</p>
<blockquote>
<p>On Thu, May 28, 2020 at 10:13:13AM +0000, osmith [REDMINE] wrote:</p>
<blockquote>
<p>Debugging this now doesn't seem a good use of time, [...]<br />I'll set this issue to resolved, [...]</p>
</blockquote>
<p>Then please at least create a separate ticket about the bug, as otherwise we<br />lose all knowledge of it.</p>
</blockquote>
<p><a class="external" href="https://osmocom.org/issues/4567">https://osmocom.org/issues/4567</a></p> Cellular Network Infrastructure - Feature #4563: install test for centos packages (like the debian install test)https://projects.osmocom.org/issues/4563?journal_id=184672020-05-29T06:18:26Zosmith
<ul><li><strong>Related to</strong> <i><a class="issue tracker-1 status-3 priority-1 priority-lowest closed" href="/issues/4567">Bug #4567</a>: rpm is failing on jenkins slave admin2-deb9build in docker</i> added</li></ul>