Retronetworking » OCTOI - Osmocom Community TDM over IP

{{>toc}}

h1. Colocated Hub

This page existed to collect information about the new (Sept 2022) colocated OCTOI hub, see #5542

h2. Block Diagrams

h3. E1/TDM network

{{graphviz_link()

graph G {

  subgraph cluster_colo {

    label = "Co-Located Hub";

    divf [label="DIVF\nCentral Switch",shape="house"];

    icE1usb;

    pm3 [label="Livingston Portmaster 3"];

    as54 [label="Cisco AS5400"];

    icE1usb -- divf [label="E1 (timing master)"];

    pm3 -- divf [label="E1"];

    as54 -- divf [label="7xE1"];

  }

  divf -- laforge [label="TDMoIP"];

  divf -- manawyrm [label="TDMoIP"];

  divf -- gruetzkopf [label="TDMoIP"];

  divf -- roox [label="TDMoIP"];

  divf -- DrDeke [label="TDMoIP"];

  etc [label="other users..."];

  divf -- etc [label="TDMoIP"];

}

}}

h3. IP network

{{graphviz_link()

graph G {

  subgraph cluster_colo {

    label = "Co-Located Hub";

    vlan [label="VLAN/Switch",shape="rect"];   

    divf [label="DIVF\nCentral Switch",shape="house"];

    apu [label="APU (hosting icE1usb)"];

    pm3 [label="Livingston Portmaster 3"];

    as54 [label="Cisco AS5400"];

    vlan -- divf;

    vlan -- apu;

    vlan -- pm3;

    vlan -- as54;

  }

  lakshmi [label="Firewall\n(lakshmi)"];

  public_v4 [label="Internet (IPv4)"];

  public_v6 [label="Internet (IPv6)"];

  divf -- lakshmi [label="VLAN 257"];

  lakshmi -- public_v4;

  lakshmi -- public_v6;

}

}}

h2. Pictures

h3. Rack setup

This picture shows OCTOI hub equipment + some other machines of @laforge:

{{thumbnail(octoi_hub-colocated.jpg, size=700)}}

h3. GPS antenna

{{thumbnail(20220919_130715.jpg, size=400)}}

h3. GPS receiver, PSU, OVP

{{thumbnail(octoi_hub-gps.jpg, size=500)}}

h2. Rackmount units

h3. Central Office server (2U / 67cm)

This is a 2U rack-mount server running all the relevant software.

See [[AVSt_Server]] for more details of the server

h4. Connections

This is a 2U rack-mount server with the following connections:

* Power

** 2x AC power connections (redundant PSU)

* Ethernet

** 1x RJ45 100-Base-TX BMC

** 2x RJ45 1000-Base-TX

* E1

** 87 E1 to a co-located Cisco AS5400 (see below)

** 1x E1 to a co-located Livingston PM3 (see below)

** 1x E1 to icE1usb/clock-source

** 2x E1 used with loop-back cable to provide proper timing from master card to slave card (timing cable has residual clock drift)

h3. icE1usb / E1 clock source (1U / 31cm)

This is a 1U rack mount system containing:

* a PC-Engines APU3 embedded x86_64

* an [[e1-t1-adapter:ICE40_E1_USB_interface|icE1usb]] with a custom RS422 interface board

* a custom rs422 over voltage protection + 12V injection board

This icE1usb acts as a GPS-disciplined clock master.  However, as no acutal RF GPS signal is available in the data centre, we are using an Ericsson [[ericsson-rbs-6xxx:GPS_02]] attached via ~100m of RS-422.

{{thumbnail(20220905_205638.jpg, size=500)}} {{thumbnail(20220831_204322.jpg)}}

h4. Connections

* Power

** 2x AC power connections (1x APU, 1x RS422/GPS)

* Ethernet

** 1x RJ45 to internal VLAN

* RS422

** 1x RJ45 towards GPS02 on the roof

h3. Cisco AS5400 RAS Server (2U / 49cm)

h4. Connections

* Power

** 2x AC power connection (redundant PSU)

* Ethernet

** 1x RJ45 Ethernet (100-Base-TX) to internal VLAN

* E1

** 8x E1 (via break-out cable) to AVSt-Server

* RS232

** Serial console connection via USB-UART to [[AVSt_Server]]

h3. Livingstion Portmaster 3 (2U / 31cm)

h4. Connections

* Power

** 1x AC power connection

* Ethernet

** 1x RJ45 Ethernet (10-Base-TX) [yes, 10MBps] to internal VLAN

* E1

** 1x E1 to AVSt-Server

* RS232

** Serial console connection via USB-UART to [[AVSt_Server]]

h2. Roof installation

On the roof of the data centre, the CAT5 cable with RS422 for the GPS03 arrives.

It will be passed through several DIN rail mounted OVP (Over Voltage Protection) circuits before  connecting to the actual DIN-rail mounted Ericsson GPS03

The Ericsson GPS03 has a SMA connector, to which a SMA-male to N-Male coaxial cable is attached.

A Times Microwave LP-GTR-NFF lightning protector (N-female to N-femaile) is used to pass the coaxial cable through the enclosure

An external GPS antenna with N connector is plugged into the LP-GTR-NFF

h3. Overview diagram

This diagram illustrates the parts and connections on the rooftop.  Rectangular objects are DIN-rail mounted.

{{graphviz_link()

graph G {

  subgraph cluster_1 {

    label="Rooftop enclosure";

    rj45splitter [label="RJ45 splitter"];

    GPS03 [label="Ericsson GPS03", shape=rect];

    ovp_rs422_1 [shape=rect];

    ovp_rs422_2 [shape=rect];

    ovp_rs422_3 [shape=rect];

    ovp_12v [shape=rect];

    lp [label="LP-GTR-NFF"];

    rj45splitter -- ovp_rs422_1;

    rj45splitter -- ovp_rs422_2;

    rj45splitter -- ovp_rs422_3;

    rj45splitter -- ovp_12v;

    ovp_rs422_1 -- GPS03;

    ovp_rs422_2 -- GPS03;

    ovp_rs422_3 -- GPS03;

    ovp_12v -- GPS03;

    GPS03 -- lp [label="SMA-male/N-female"];

  }

  antenna [label="GPS Antenna"];

  antenna -- lp [label="RG58 white / N-female"];

  rack [label="Rack in DC"];

  rack -- rj45splitter [label="CAT5"];

}

}}

h2. Software

* Like in the current hub at @laforge's basement, we should run the entire yate / osmo-e1d / dahdi-trunkdev inside a KVM with SR-IOV mapping the PCI devices

h2. Network

h2. Public IP

|_.Host|_.IPv4|_.IPv6|_.IPv4-internal|

|avst|213.95.46.30|?|192.168.7.129/25|

|divf|213.95.46.31|?|192.168.7.130/25|

|as5400|213.95.46.29|?|192.168.7.133|

|pm3|-|-|192.168.7.132|

|icE1-apu|-|-|192.168.7.131|

|stats|213.95.46.27|-|192.168.7.134|

|avst-bmc|213.95.46.28|?|-|

h2. Misc / TODO

h3. local verification with modem/ISDN-TA

It would be great if we could somehow verify local calls via the yate / hub excluding the complexity of the TDMoIP to compare calls without TDMoIP to calls with TDMoIP.

Unfortuantely I'm not aware of any really small PBX that would terminate the E1/S2M and offer S0/POTS ports.  Adding antoher 3U for a PBX seems excessive.

Doing calls between PM3 and ASR5400 is of course an option, but ideally we'd have a real physical modem attached via a serial port, and a real HFC-S-USB for test purpose.

h2. High-level parameters for data centre

* 7U rackspace

* 7x AC power outlet

* 7x Ethernet switch port (one of which supports 10 MBps!)

** some ports in a new VLAN

** some ports in an existing VLAN of my other servers in Rack 1120

* 1x CAT5 between rack and roof

* about 10cm of space on DIN-rail on roof enclosure (to mount OVP + GPS03)

h2. Questions

* Required antenna cable length between rooftop enclosure and antenna

* Mechanical antenna mounting details

* detailed switch port / VLAN config