Actions
Bug #5725
closedAssert failed mm->gb.mm_state_fsm->state != ST_MM_IDLE sgsn_libgtp.c:771
Added by keith over 1 year ago. Updated over 1 year ago.
Start date:
10/24/2022
Due date:
% Done:
100%
Spec Reference:
Description
Just happened to notice a coredump due to hitting this in sgsn_libgtp.c:771
OSMO_ASSERT(mm->gb.mm_state_fsm->state != ST_MM_IDLE);
Updated by keith over 1 year ago
This seems to be happening quite a lot. 2 or 3 times per day.
I need to install some debug syms and increase the log levels
#0 __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1 0x00007faa315bc42a in __GI_abort () at abort.c:89
#2 0x00007faa328b4400 in osmo_panic () from /usr/lib/x86_64-linux-gnu/libosmocore.so.19
#3 0x000056497ee5605f in cb_data_ind (lib=<optimized out>, packet=0x7ffd4a45aa0c, len=88) at sgsn_libgtp.c:771
#4 0x00007faa32055184 in gtp_gpdu_ind (gsn=gsn@entry=0x7faa2f80b010, version=version@entry=1 '\001', peer=peer@entry=0x7ffd4a45a9f0, fd=fd@entry=9, pack=pack@entry=0x7ffd4a45aa00,
len=len@entry=100) at gtp.c:2966
#5 0x00007faa32059cec in gtp_decaps1u (gsn=0x7faa2f80b010) at gtp.c:3423
#6 0x00007faa328a2cbc in ?? () from /usr/lib/x86_64-linux-gnu/libosmocore.so.19
#7 0x00007faa328a2d76 in osmo_select_main () from /usr/lib/x86_64-linux-gnu/libosmocore.so.19
#8 0x000056497ee3aa4c in main (argc=3, argv=<optimized out>) at sgsn_main.c:542
not that it is probably of much use, but lead up error log:
Oct 31 14:31:22 nuyoo osmo-sgsn[28915]: 20221031143122537 DMM ERROR <0000> LLME(ffffffff/bba37827){UNASSIGNED} Rejecting GMM RA Update Request: MS should GMM Attach first (gprs_gmm.c
Oct 31 14:31:24 nuyoo osmo-sgsn[28915]: 20221031143124600 DMM ERROR <0000> MM(334020493128902/e85148d0) Stopping MM timer 3370 but 0 is running (gprs_gmm.c:115)
Oct 31 14:31:30 nuyoo osmo-sgsn[28915]: 20221031143130264 DMM ERROR <0000> LLME(ffffffff/a6a0718f){UNASSIGNED} Rejecting GMM RA Update Request: MS should GMM Attach first (gprs_gmm.c
Oct 31 14:31:36 nuyoo osmo-sgsn[28915]: 20221031143136245 DMM ERROR <0000> MM(/f43665c7) Stopping MM timer 3370 but 0 is running (gprs_gmm.c:115)
Oct 31 14:31:36 nuyoo osmo-sgsn[28915]: 20221031143136245 DMM ERROR <0000> MM(334020150761030/f43665c7) Stopping MM timer 3370 but 0 is running (gprs_gmm.c:115)
Oct 31 14:31:36 nuyoo osmo-sgsn[28915]: 20221031143136245 DMM ERROR <0000> GMM_ATTACH_REQ_FSM(gb_gmm_req)[0x5649802d28b0]{WaitAttachComplete}: Event E_IDEN_RESP_RECV not permitted (g
Oct 31 14:31:36 nuyoo osmo-sgsn[28915]: 20221031143136281 DMM ERROR <0000> MM(334020150761030/f43665c7) Stopping MM timer 3370 but 0 is running (gprs_gmm.c:115)
Oct 31 14:31:36 nuyoo osmo-sgsn[28915]: 20221031143136281 DMM ERROR <0000> GMM_ATTACH_REQ_FSM(gb_gmm_req)[0x5649802d28b0]{WaitAttachComplete}: Event E_IDEN_RESP_RECV not permitted (g
Oct 31 14:31:37 nuyoo osmo-sgsn[28915]: 20221031143137315 DMM ERROR <0000> MM(334020332996726/c89f3962) Starting MM timer 3350 while old timer 3350 pending (gprs_gmm.c:99)
Oct 31 14:31:37 nuyoo osmo-sgsn[28915]: 20221031143137499 DMM ERROR <0000> MM(334020493128902/e85148d0) Stopping MM timer 3370 but 0 is running (gprs_gmm.c:115)
Oct 31 14:31:37 nuyoo osmo-sgsn[28915]: 20221031143137518 DMM ERROR <0000> LLME(ffffffff/bba37827){UNASSIGNED} Rejecting GMM RA Update Request: MS should GMM Attach first (gprs_gmm.c
Oct 31 14:31:40 nuyoo osmo-sgsn[28915]: 20221031143140038 DMM ERROR <0000> MM(334020494291016/d6dc58a1) Stopping MM timer 3370 but 0 is running (gprs_gmm.c:115)
Oct 31 14:31:40 nuyoo osmo-sgsn[28915]: 20221031143140380 DMM ERROR <0000> MM(334020494291016/d6dc58a1) Stopping MM timer 3350 but 0 is running (gprs_gmm.c:115)
Oct 31 14:31:43 nuyoo osmo-sgsn[28915]: 20221031143143404 DMM ERROR <0000> MM(334020150761030/f43665c7) Stopping MM timer 3370 but 0 is running (gprs_gmm.c:115)
Oct 31 14:31:43 nuyoo osmo-sgsn[28915]: 20221031143143404 DMM ERROR <0000> GMM_ATTACH_REQ_FSM(gb_gmm_req)[0x5649802d28b0]{WaitAttachComplete}: Event E_IDEN_RESP_RECV not permitted (g
Oct 31 14:31:43 nuyoo osmo-sgsn[28915]: 20221031143143404 DMM ERROR <0000> MM(334020150761030/f43665c7) Stopping MM timer 3370 but 0 is running (gprs_gmm.c:115)
Oct 31 14:31:43 nuyoo osmo-sgsn[28915]: 20221031143143404 DMM ERROR <0000> GMM_ATTACH_REQ_FSM(gb_gmm_req)[0x5649802d28b0]{WaitAttachComplete}: Event E_IDEN_RESP_RECV not permitted (g
Oct 31 14:31:43 nuyoo osmo-sgsn[28915]: 20221031143143421 DMM ERROR <0000> MM(334020150761030/f43665c7) Stopping MM timer 3370 but 0 is running (gprs_gmm.c:115)
Oct 31 14:31:43 nuyoo osmo-sgsn[28915]: 20221031143143421 DMM ERROR <0000> GMM_ATTACH_REQ_FSM(gb_gmm_req)[0x5649802d28b0]{WaitAttachComplete}: Event E_IDEN_RESP_RECV not permitted (g
Oct 31 14:31:43 nuyoo osmo-sgsn[28915]: 20221031143143482 DMM ERROR <0000> MM(334020150761030/f43665c7) Stopping MM timer 3350 but 0 is running (gprs_gmm.c:115)
Oct 31 14:31:43 nuyoo osmo-sgsn[28915]: 20221031143143482 DMM ERROR <0000> GMM_ATTACH_REQ_FSM(gb_gmm_req)[0x5649802d28b0]{CheckIdentity}: Event E_ATTACH_COMPLETE_RECV not permitted (
Oct 31 14:31:43 nuyoo osmo-sgsn[28915]: 20221031143143523 DMM ERROR <0000> MM(334020150761030/f43665c7) Stopping MM timer 3350 but 0 is running (gprs_gmm.c:115)
Oct 31 14:31:43 nuyoo osmo-sgsn[28915]: 20221031143143523 DMM ERROR <0000> GMM(gmm_fsm)[0x5649805f1340]{Registered.NORMAL}: Event E_GMM_ATTACH_SUCCESS not permitted (gprs_gmm.c:1403)
Oct 31 14:31:43 nuyoo osmo-sgsn[28915]: 20221031143143523 DMM ERROR <0000> MM_STATE_Gb(2954529642)[0x5649803b0690]{Ready}: Event E_MM_GPRS_ATTACH not permitted (gprs_gmm.c:1414)
Oct 31 14:31:43 nuyoo osmo-sgsn[28915]: 20221031143143523 DMM ERROR <0000> GMM_ATTACH_REQ_FSM(gb_gmm_req)[0x5649802d28b0]{CheckIdentity}: Event E_ATTACH_COMPLETE_RECV not permitted (
Oct 31 14:31:43 nuyoo osmo-sgsn[28915]: 20221031143143540 DMM ERROR <0000> LLME(ffffffff/95f70f0e){UNASSIGNED} Rejecting GMM RA Update Request: MS should GMM Attach first (gprs_gmm.c
Oct 31 14:31:45 nuyoo osmo-sgsn[28915]: 20221031143145324 DMM ERROR <0000> LLME(ffffffff/a6a0718f){UNASSIGNED} Rejecting GMM RA Update Request: MS should GMM Attach first (gprs_gmm.c
Oct 31 14:31:50 nuyoo osmo-sgsn[28915]: 20221031143150313 DMM ERROR <0000> LLME(ffffffff/b1bbd82a){UNASSIGNED} Rejecting GMM RA Update Request: MS should GMM Attach first (gprs_gmm.c
Oct 31 14:31:50 nuyoo osmo-sgsn[28915]: 20221031143150372 DMM ERROR <0000> LLME(ffffffff/b1bbd82a){UNASSIGNED} Rejecting GMM RA Update Request: MS should GMM Attach first (gprs_gmm.c
Oct 31 14:31:51 nuyoo osmo-sgsn[28915]: 20221031143151132 DMM ERROR <0000> MM(/f6cccc2a) Stopping MM timer 3370 but 0 is running (gprs_gmm.c:115)
Oct 31 14:31:51 nuyoo osmo-sgsn[28915]: 20221031143151474 DMM ERROR <0000> MM(/f6cccc2a) Stopping MM timer 3370 but 0 is running (gprs_gmm.c:115)
Oct 31 14:31:51 nuyoo osmo-sgsn[28915]: 20221031143151519 DMM ERROR <0000> MM(334020542911177/d1501489) Stopping MM timer 3370 but 3350 is running (gprs_gmm.c:115)
Oct 31 14:31:51 nuyoo osmo-sgsn[28915]: 20221031143151756 DMM ERROR <0000> MM(334020493128902/e85148d0) Stopping MM timer 3370 but 0 is running (gprs_gmm.c:115)
Oct 31 14:31:51 nuyoo osmo-sgsn[28915]: 20221031143151852 DMM ERROR <0000> MM(334020336014155/f6cccc2a) Stopping MM timer 3350 but 0 is running (gprs_gmm.c:115)
Oct 31 14:31:51 nuyoo osmo-sgsn[28915]: 20221031143151939 DMM ERROR <0000> MM_STATE_Gb(0)[0x56498033a8f0]{Ready}: Event E_MM_GPRS_ATTACH not permitted (gprs_gmm.c:1414)
Oct 31 14:31:52 nuyoo osmo-sgsn[28915]: 20221031143152596 DMM ERROR <0000> LLME(ffffffff/bba37827){UNASSIGNED} Rejecting GMM RA Update Request: MS should GMM Attach first (gprs_gmm.c
Oct 31 14:31:52 nuyoo osmo-sgsn[28915]: 20221031143152753 DMM ERROR <0000> MM(334020332996726/c89f3962) Starting MM timer 3350 while old timer 3350 pending (gprs_gmm.c:99)
Oct 31 14:31:52 nuyoo osmo-sgsn[28915]: 20221031143152974 DMM ERROR <0000> LLME(ffffffff/cfe0a465){UNASSIGNED} Rejecting GMM RA Update Request: MS should GMM Attach first (gprs_gmm.c
Oct 31 14:31:53 nuyoo osmo-sgsn[28915]: 20221031143153034 DMM ERROR <0000> LLME(ffffffff/cfe0a465){UNASSIGNED} Rejecting GMM RA Update Request: MS should GMM Attach first (gprs_gmm.c
Oct 31 14:31:53 nuyoo osmo-sgsn[28915]: 20221031143153436 DMM ERROR <0000> MM(334020337886184/f87d0617) Stopping MM timer 3370 but 3350 is running (gprs_gmm.c:115)
Oct 31 14:31:53 nuyoo osmo-sgsn[28915]: 20221031143153779 DMM ERROR <0000> MM_STATE_Gb(2536472285)[0x5649805d42c0]{Ready}: Event E_MM_GPRS_ATTACH not permitted (gprs_gmm.c:1414)
Oct 31 14:31:58 nuyoo osmo-sgsn[28915]: 20221031143158577 DMM ERROR <0000> LLME(ffffffff/95f70f0e){UNASSIGNED} Rejecting GMM RA Update Request: MS should GMM Attach first (gprs_gmm.c
Oct 31 14:32:00 nuyoo osmo-sgsn[28915]: 20221031143200223 DMM ERROR <0000> LLME(ffffffff/a6a0718f){UNASSIGNED} Rejecting GMM RA Update Request: MS should GMM Attach first (gprs_gmm.c
Oct 31 14:32:07 nuyoo osmo-sgsn[28915]: 20221031143207379 DMM ERROR <0000> LLME(ffffffff/bba37827){UNASSIGNED} Rejecting GMM RA Update Request: MS should GMM Attach first (gprs_gmm.c
Oct 31 14:32:07 nuyoo osmo-sgsn[28915]: 20221031143207914 DMM ERROR <0000> MM(334020332996726/c89f3962) Starting MM timer 3350 while old timer 3350 pending (gprs_gmm.c:99)
Oct 31 14:32:08 nuyoo osmo-sgsn[28915]: 20221031143208658 DMM ERROR <0000> MM(334020493128902/e85148d0) Stopping MM timer 3370 but 0 is running (gprs_gmm.c:115)
Oct 31 14:32:11 nuyoo osmo-sgsn[28915]: 20221031143211945 DMM ERROR <0000> LLME(ffffffff/9396506e){UNASSIGNED} Rejecting GMM RA Update Request: MS should GMM Attach first (gprs_gmm.c
Oct 31 14:32:12 nuyoo osmo-sgsn[28915]: 20221031143212695 DMM ERROR <0000> MM(334020341918679/d7ed81d2) Starting MM timer 3350 while old timer 3350 pending (gprs_gmm.c:99)
Oct 31 14:32:12 nuyoo osmo-sgsn[28915]: 20221031143212821 DMM ERROR <0000> MM(/d5f93c59) Stopping MM timer 3370 but 0 is running (gprs_gmm.c:115)
Oct 31 14:32:13 nuyoo osmo-sgsn[28915]: 20221031143213265 DMM ERROR <0000> MM(/d5f93c59) Stopping MM timer 3370 but 0 is running (gprs_gmm.c:115)
Oct 31 14:32:13 nuyoo osmo-sgsn[28915]: 20221031143213498 DMM ERROR <0000> LLME(ffffffff/95f70f0e){UNASSIGNED} Rejecting GMM RA Update Request: MS should GMM Attach first (gprs_gmm.c
Oct 31 14:32:13 nuyoo osmo-sgsn[28915]: 20221031143213685 DMM ERROR <0000> MM(334020534271214/d5f93c59) Stopping MM timer 3350 but 0 is running (gprs_gmm.c:115)
Oct 31 14:32:19 nuyoo osmo-sgsn[28915]: 20221031143219283 DMM ERROR <0000> GMM(gmm_fsm)[0x5649804da580]{Registered.NORMAL}: Event E_GMM_COMMON_PROC_SUCCESS not permitted (gprs_gmm.c:
Oct 31 14:32:21 nuyoo osmo-sgsn[28915]: 20221031143221816 DMM ERROR <0000> MM(334020493128902/e85148d0) Stopping MM timer 3370 but 0 is running (gprs_gmm.c:115)
Oct 31 14:32:22 nuyoo osmo-sgsn[28915]: 20221031143222714 DMM ERROR <0000> MM(334020332996726/c89f3962) Starting MM timer 3350 while old timer 3350 pending (gprs_gmm.c:99)
Oct 31 14:32:24 nuyoo osmo-sgsn[28915]: 20221031143224272 DMM ERROR <0000> GMM(gmm_fsm)[0x5649802e5e10]{Registered.NORMAL}: Event E_GMM_COMMON_PROC_SUCCESS not permitted (gprs_gmm.c:
Oct 31 14:32:25 nuyoo osmo-sgsn[28915]: 20221031143225300 DMM ERROR <0000> LLME(ffffffff/91887938){UNASSIGNED} Rejecting GMM RA Update Request: MS should GMM Attach first (gprs_gmm.c
Oct 31 14:32:28 nuyoo osmo-sgsn[28915]: 20221031143228231 DMM ERROR <0000> LLME(ffffffff/851c5653){UNASSIGNED} Rejecting GMM RA Update Request: MS should GMM Attach first (gprs_gmm.c
Oct 31 14:32:28 nuyoo osmo-sgsn[28915]: 20221031143228626 DMM ERROR <0000> LLME(ffffffff/95f70f0e){UNASSIGNED} Rejecting GMM RA Update Request: MS should GMM Attach first (gprs_gmm.c
Oct 31 14:32:30 nuyoo osmo-sgsn[28915]: 20221031143230305 DMM ERROR <0000> LLME(ffffffff/a6a0718f){UNASSIGNED} Rejecting GMM RA Update Request: MS should GMM Attach first (gprs_gmm.c
Oct 31 14:32:30 nuyoo osmo-sgsn[28915]: 20221031143230456 DMM ERROR <0000> MM(334020341918679/d7ed81d2) Starting MM timer 3350 while old timer 3350 pending (gprs_gmm.c:99)
Oct 31 14:32:31 nuyoo osmo-sgsn[28915]: 20221031143231333 DMM ERROR <0000> MM(334020152732252/c994dad7) Starting MM timer 3350 while old timer 3350 pending (gprs_gmm.c:99)
Oct 31 14:32:32 nuyoo osmo-sgsn[28915]: 20221031143232056 DMM ERROR <0000> MM(/dd4865d2) Stopping MM timer 3370 but 0 is running (gprs_gmm.c:115)
Oct 31 14:32:37 nuyoo osmo-sgsn[28915]: 20221031143237577 DMM ERROR <0000> LLME(ffffffff/bba37827){UNASSIGNED} Rejecting GMM RA Update Request: MS should GMM Attach first (gprs_gmm.c
Oct 31 14:32:37 nuyoo osmo-sgsn[28915]: 20221031143237712 DMM ERROR <0000> MM(334020332996726/c89f3962) Starting MM timer 3350 while old timer 3350 pending (gprs_gmm.c:99)
Oct 31 14:32:39 nuyoo osmo-sgsn[28915]: 20221031143239059 DMM ERROR <0000> MM(/dd4865d2) Stopping MM timer 3370 but 0 is running (gprs_gmm.c:115)
Oct 31 14:32:39 nuyoo osmo-sgsn[28915]: 20221031143239059 DGPRS ERROR <0004> PDP(---/0) Stopping PDP timer 3395 but 0 is running (gprs_sm.c:117)
Oct 31 14:32:39 nuyoo osmo-sgsn[28915]: 20221031143239059 DMM ERROR <0000> MM(334020166805078/dd4865d2) Stopping MM timer 3370 but 0 is running (gprs_gmm.c:115)
Oct 31 14:32:39 nuyoo osmo-sgsn[28915]: 20221031143239059 DMM ERROR <0000> GMM_ATTACH_REQ_FSM(gb_gmm_req)[0x56498041fad0]{WaitAttachComplete}: Event E_IDEN_RESP_RECV not permitted (g
Oct 31 14:32:42 nuyoo osmo-sgsn[28915]: 20221031143242678 DMM ERROR <0000> MM(334020341918679/d7ed81d2) Starting MM timer 3350 while old timer 3350 pending (gprs_gmm.c:99)
Oct 31 14:32:42 nuyoo osmo-sgsn[28915]: 20221031143242835 DMM ERROR <0000> LLME(ffffffff/99ef20d8){UNASSIGNED} Rejecting GMM RA Update Request: MS should GMM Attach first (gprs_gmm.c
Oct 31 14:32:43 nuyoo osmo-sgsn[28915]: 20221031143243524 DMM ERROR <0000> LLME(ffffffff/95f70f0e){UNASSIGNED} Rejecting GMM RA Update Request: MS should GMM Attach first (gprs_gmm.c
Oct 31 14:32:44 nuyoo osmo-sgsn[28915]: 20221031143244723 DMM ERROR <0000> LLME(ffffffff/a6a0718f){UNASSIGNED} Rejecting GMM RA Update Request: MS should GMM Attach first (gprs_gmm.c
Oct 31 14:32:45 nuyoo osmo-sgsn[28915]: 20221031143245194 DMM ERROR <0000> MM(/c1d88fbc) Stopping MM timer 3370 but 0 is running (gprs_gmm.c:115)
Oct 31 14:32:45 nuyoo osmo-sgsn[28915]: 20221031143245575 DMM ERROR <0000> MM(/c1d88fbc) Stopping MM timer 3370 but 0 is running (gprs_gmm.c:115)
Oct 31 14:32:45 nuyoo osmo-sgsn[28915]: 20221031143245992 DMM ERROR <0000> MM(334020160892250/c1d88fbc) Stopping MM timer 3350 but 0 is running (gprs_gmm.c:115)
Oct 31 14:32:47 nuyoo osmo-sgsn[28915]: 20221031143247712 DMM ERROR <0000> MM(/f7e14968) Stopping MM timer 3370 but 0 is running (gprs_gmm.c:115)
Oct 31 14:32:48 nuyoo osmo-sgsn[28915]: 20221031143248091 DMM ERROR <0000> MM(/f7e14968) Stopping MM timer 3370 but 0 is running (gprs_gmm.c:115)
Oct 31 14:32:48 nuyoo osmo-sgsn[28915]: 20221031143248091 DGPRS ERROR <0004> PDP(---/0) Stopping PDP timer 3395 but 0 is running (gprs_sm.c:117)
Oct 31 14:32:48 nuyoo osmo-sgsn[28915]: 20221031143248434 DMM ERROR <0000> MM(334020492529924/f7e14968) Stopping MM timer 3350 but 0 is running (gprs_gmm.c:115)
Oct 31 14:32:49 nuyoo osmo-sgsn[28915]: 20221031143249539 DMM ERROR <0000> MM_STATE_Gb(2441640248)[0x5649803b0690]{Idle}: Event E_MM_RA_UPDATE not permitted (gprs_gmm.c:1851)
Oct 31 14:32:50 nuyoo osmo-sgsn[28915]: Assert failed mm->gb.mm_state_fsm->state != ST_MM_IDLE sgsn_libgtp.c:771
Updated by keith over 1 year ago
- Subject changed from note on assert to Assert failed mm->gb.mm_state_fsm->state != ST_MM_IDLE sgsn_libgtp.c:771
- Priority changed from Low to Normal
Updated by osmith over 1 year ago
- Status changed from New to In Progress
- Assignee changed from keith to osmith
Updated by osmith over 1 year ago
- % Done changed from 0 to 90
Patch to turn the assert into an error log msg: https://gerrit.osmocom.org/c/osmo-sgsn/+/30206
Updated by osmith over 1 year ago
- Status changed from In Progress to Resolved
- % Done changed from 90 to 100
Applied in changeset osmo-sgsn|55e3dc8ec82ce0707b4811b8ce984572416de722.
Actions
