Bug #6163
openUpdate distributions in OBS (wait until 2024-02)
60%
Description
This issue is about making the Linux distributions we build for in OBS more consistent, and ensuring that we don't build for distributions that nobody is using.
Recent package download stats (crawlers filtered out, script, checked out in /root/access-log-stats on downloads.osmocom.org):
Date range: 04/Jun/2023:00:01:27 +0200 - 31/Aug/2023:14:04:49 +0200 Distributions: 125453 Debian_11 124541 CentOS_8 56912 Debian_12 47603 Debian_10 14298 xUbuntu_20.04 2852 xUbuntu_22.04 1692 CentOS_7 681 xUbuntu_18.04 365 Debian_Unstable 354 Debian_Testing 90 xUbuntu_23.04 47 Debian_9.0 42 Raspbian_10 34 xUbuntu_20.10 15 Raspbian_11 13 openSUSE_TumbleweedNotes:
- There were a lot of crawlers (search engines, AI companies). I've added a robots.txt disallowing package related directories: https://downloads.osmocom.org/robots.txt
- EOL distro ubuntu 18.04 has very few downloads, and 21.04 has none. I've removed them from OBS.
- openSUSE 15.4 has 0 downloads (not listed).
- I didn't expect Ubuntu 20.04 to get used that much.
- Raspbian 10 and 11 (barely used and debian aarch64 packages can be used instead for newer Pis)
- openSUSE 15.4, keeping only Tumbleweed (we did not have the latest version 15.5 enabled)
Draft of a new wiki page to list which distros we have enabled, and when to add/remove them:
https://osmocom.org/projects/cellular-infrastructure/wiki/Linux_Distributions
Checklist
- add latest distros (Rasberry Pi OS 12, Ubuntu 23.10)
- post news entry about removal of some distros
- post to mailing lists
- wait until 2024-02 before removing distros, as announced
- remove raspberry pi OS 64 bit
- remove ubuntu 23.04 (will be EOL then)
- remove openSUSE 15.4
- remove Debian Testing
Updated by osmith 3 months ago
libosmocore master was currently not building for ubuntu 20.04, fixed here: https://gerrit.osmocom.org/c/libosmocore/+/34260
Updated by osmith 3 months ago
- Status changed from New to Feedback
- Assignee changed from osmith to laforge
- % Done changed from 0 to 30
osmith wrote:
Based on the stats above, I think it makes sense to remove:
- Raspbian 10 and 11 (barely used and debian aarch64 packages can be used instead for newer Pis)
- openSUSE 15.4, keeping only Tumbleweed (we did not have the latest version 15.5 enabled)
Harald, does this look good? If so, I'd write an announcement that we remove these in 2 months and then remove them.
Updated by laforge 3 months ago
Agreeing in general, but:
On Thu, Aug 31, 2023 at 12:48:33PM +0000, osmith wrote:
Based on the stats above, I think it makes sense to remove:
- Raspbian 10 and 11 (barely used and debian aarch64 packages can be used instead for newer Pis)
I would prefer to keep them for armv7l, while abandoning them for aarch64 if we properly document this
so the average user understands how they can use the feeds on aarc64.
Updated by osmith 3 months ago
Stats generated again, without and with our IPs.
Without our IPs:
Date range: 04/Jun/2023:00:01:27 +0200 - 31/Aug/2023:16:49:01 +0200 Excluding 17 netmasks: 375218 lines in 40390 lines out Distributions: 17774 Debian_11 14298 xUbuntu_20.04 2852 xUbuntu_22.04 2295 Debian_12 1309 Debian_10 681 xUbuntu_18.04 354 Debian_Testing 347 Debian_Unstable 187 CentOS_8 90 xUbuntu_23.04 52 CentOS_7 47 Debian_9.0 42 Raspbian_10 34 xUbuntu_20.10 15 Raspbian_11 13 openSUSE_Tumbleweed
With our IPs:
Date range: 04/Jun/2023:00:01:27 +0200 - 31/Aug/2023:16:50:06 +0200 Distributions: 125525 Debian_11 124541 CentOS_8 57047 Debian_12 47603 Debian_10 14298 xUbuntu_20.04 2852 xUbuntu_22.04 1711 CentOS_7 681 xUbuntu_18.04 365 Debian_Unstable 354 Debian_Testing 90 xUbuntu_23.04 47 Debian_9.0 42 Raspbian_10 34 xUbuntu_20.10 15 Raspbian_11 13 openSUSE_Tumbleweed
Updated by osmith 3 days ago
- Checklist item add latest distros (Rasberry Pi OS 12, Ubuntu 23.10) added
- Checklist item post news entry about removal of some distros added
- Checklist item post to mailing lists added
- Checklist item wait until 2024-02 before removing distros, as announced added
- Checklist item remove raspberry pi OS 64 bit added
- Checklist item remove ubuntu 23.04 (will be EOL then) added
- Checklist item remove openSUSE 15.4 added
- Checklist item remove Debian Testing added
- % Done changed from 30 to 50
laforge wrote in #note-3:
Agreeing in general, but:
On Thu, Aug 31, 2023 at 12:48:33PM +0000, osmith wrote:
Based on the stats above, I think it makes sense to remove:
- Raspbian 10 and 11 (barely used and debian aarch64 packages can be used instead for newer Pis)
I would prefer to keep them for armv7l, while abandoning them for aarch64 if we properly document this
so the average user understands how they can use the feeds on aarc64.
Latest_Builds and Nightly_Builds now explain that Raspberry Pi OS users with aarch64 should use the Debian feeds.
I've noticed that openSUSE's OBS also only uses packages from archive.raspbian.org for armv7l, the aarch64 builds of Raspbian use debian feeds.- https://build.opensuse.org/project/show/Raspbian:12 (this was actually broken, explained the problem in #opensuse-buildservice IRC channel and now it is fixed)
- https://build.opensuse.org/project/show/Raspbian:11
- https://build.opensuse.org/project/show/Raspbian:10
laforge: I propose the following news entry, is it fine if I post it?
Title: Binary packages: changes in supported distributions
The official Osmocom [[binary packages]] will not be built anymore for
the following distributions starting at 2024-02:
* Raspberry Pi OS 64-bit (use Debian_12 etc. instead)
* Ubuntu 23.04 (Ubuntu 23.10 and LTS 20.04/22.04 feeds are available)
* openSUSE 15.4 (openSUSE Tumbleweed feed is available)
* Debian Testing (Debian Unstable and 12-10 feeds are available)
For Raspberry Pi OS 64-bit users, make sure to adjust your
<code>/etc/apt/sources.list.d</code> as
"described here":https://osmocom.org/projects/cellular-infrastructure/wiki/Latest_Builds
to switch to a Debian aarch64 feed.
See the new "linux distributions":https://osmocom.org/projects/cellular-infrastructure/wiki/Linux_Distributions
article for information on how long we plan to keep building packages for each
distribution.
Additionally I've added Ubuntu 23.10 and Raspberry Pi OS 12 (32 bit), and created a jenkins job that checks whether new Debian, Raspbian or Ubuntu versions have been added to the openSUSE OBS that we don't have yet in our OBS. It fails if that is the case, and so we should be able to consistently add the new versions (and drop e.g. old EOL Ubuntu releases) shortly after they are available in openSUSE OBS:
https://gerrit.osmocom.org/q/topic:update-obs-distros
When the jenkins job fails, it points to this new article describing how to add the new release:
https://osmocom.org/projects/cellular-infrastructure/wiki/Add_a_new_distribution_to_OBS
Updated by laforge 3 days ago
On Tue, Dec 05, 2023 at 01:22:34PM +0000, redmine@osmocom.org wrote:
laforge: I propose the following news entry, is it fine if I post it?
yes, fine with me. Thanks!
Additionally I've added Ubuntu 23.10 and Raspberry Pi OS 12 (32 bit), and created a jenkins job that checks whether new Debian, Raspbian or Ubuntu versions have been added to the openSUSE OBS that we don't have yet in our OBS. It fails if that is the case, and so we should be able to consistently add the new versions (and drop e.g. old EOL Ubuntu releases) shortly after they are available in openSUSE OBS:
https://gerrit.osmocom.org/q/topic:update-obs-distros
excellent.
Updated by osmith 3 days ago
- Checklist item post news entry about removal of some distros set to Done
- Checklist item post to mailing lists set to Done
- Subject changed from Update distributions in OBS to Update distributions in OBS (wait until 2024-02)
- Status changed from In Progress to Stalled
- % Done changed from 50 to 60