Colocated Hub » History » Revision 20
Revision 19 (laforge, 09/23/2022 08:12 AM) → Revision 20/27 (laforge, 09/23/2022 08:38 AM)
{{>toc}}
h1. Colocated Hub
This page existed exists to collect planning about the future (Sept 2022) colocated OCTOI hub, see #5542
h2. Block Diagrams
h3. E1/TDM network
{{graphviz_link()
graph G {
subgraph cluster_colo {
label = "Co-Located Hub";
divf [label="DIVF\nCentral Switch",shape="house"];
icE1usb;
pm3 [label="Livingston Portmaster 3"];
as54 [label="Cisco AS5400"];
icE1usb -- divf [label="E1 (timing master)"];
pm3 -- divf [label="E1"];
as54 -- divf [label="7xE1"]; [label="8xE1"];
}
divf -- laforge [label="TDMoIP"];
divf -- manawyrm [label="TDMoIP"];
divf -- gruetzkopf [label="TDMoIP"];
divf -- roox [label="TDMoIP"];
divf -- DrDeke [label="TDMoIP"];
etc [label="other users..."];
divf -- etc [label="TDMoIP"];
}
}}
h3. IP network
{{graphviz_link()
graph G {
subgraph cluster_colo {
label = "Co-Located Hub";
vlan [label="VLAN/Switch",shape="rect"];
divf [label="DIVF\nCentral Switch",shape="house"];
apu [label="APU (hosting icE1usb)"];
pm3 [label="Livingston Portmaster 3"];
as54 [label="Cisco AS5400"];
vlan -- divf;
vlan -- apu;
vlan -- pm3;
vlan -- as54;
}
lakshmi [label="Firewall\n(lakshmi)"];
public_v4 [label="Internet (IPv4)"];
public_v6 [label="Internet (IPv6)"];
divf -- lakshmi [label="VLAN 257"];
lakshmi -- public_v4;
lakshmi -- public_v6;
}
}}
h2. Rackmount units
h3. Central Office server (2U / 67cm)
This is a 2U rack-mount server running all the relevant software.
See [[AVSt_Server]] for more details of the server
h4. Connections
This is a 2U rack-mount server with the following connections:
* Power
** 2x AC power connections (redundant PSU)
* Ethernet
** 1x RJ45 100-Base-TX BMC
** 2x RJ45 1000-Base-TX
* E1
** 87 8x E1 to a co-located Cisco AS5400 (see below)
** 1x E1 to a co-located Livingston PM3 (see below)
** 1x E1 to icE1usb/clock-source
** 2x E1 used with loop-back cable to provide proper timing from master card to slave card (timing cable has residual clock drift)
h3. icE1usb / E1 clock source (1U / 31cm)
This is a 1U rack mount system containing:
* a PC-Engines APU3 embedded x86_64
* an [[e1-t1-adapter:ICE40_E1_USB_interface|icE1usb]] with a custom RS422 interface board
* a custom rs422 over voltage protection + 12V injection board
This icE1usb acts as a GPS-disciplined clock master. However, as no acutal RF GPS signal is available in the data centre, we are using an Ericsson [[ericsson-rbs-6xxx:GPS_02]] attached via ~100m of RS-422.
h4. Connections
* Power
** 2x AC power connections (1x APU, 1x RS422/GPS)
* Ethernet
** 1x RJ45 to internal VLAN
* RS422
** 1x RJ45 towards GPS02 on the roof
h3. Cisco AS5400 RAS Server (2U / 49cm)
h4. Connections
* Power
** 2x AC power connection (redundant PSU)
* Ethernet
** 1x RJ45 Ethernet (100-Base-TX) to internal VLAN
* E1
** 8x E1 (via break-out cable) to AVSt-Server
* RS232
** Serial console connection via USB-UART to [[AVSt_Server]]
h3. Livingstion Portmaster 3 (2U / 31cm)
h4. Connections
* Power
** 1x AC power connection
* Ethernet
** 1x RJ45 Ethernet (10-Base-TX) [yes, 10MBps] to internal VLAN
* E1
** 1x E1 to AVSt-Server
* RS232
** Serial console connection via USB-UART to [[AVSt_Server]]
h2. Roof installation
On the roof of the data centre, the CAT5 cable with RS422 for the GPS03 arrives.
It will be passed through several DIN rail mounted OVP (Over Voltage Protection) circuits before connecting to the actual DIN-rail mounted Ericsson GPS03
The Ericsson GPS03 has a SMA connector, to which a SMA-male to N-Male coaxial cable is attached.
A Times Microwave LP-GTR-NFF lightning protector (N-female to N-femaile) is used to pass the coaxial cable through the enclosure
An external GPS antenna with N connector is plugged into the LP-GTR-NFF
h3. Overview diagram
This diagram illustrates the parts and connections on the rooftop. Rectangular objects are DIN-rail mounted.
{{graphviz_link()
graph G {
subgraph cluster_1 {
label="Rooftop enclosure";
rj45splitter [label="RJ45 splitter"];
GPS03 [label="Ericsson GPS03", shape=rect];
ovp_rs422_1 [shape=rect];
ovp_rs422_2 [shape=rect];
ovp_rs422_3 [shape=rect];
ovp_12v [shape=rect];
lp [label="LP-GTR-NFF"];
rj45splitter -- ovp_rs422_1;
rj45splitter -- ovp_rs422_2;
rj45splitter -- ovp_rs422_3;
rj45splitter -- ovp_12v;
ovp_rs422_1 -- GPS03;
ovp_rs422_2 -- GPS03;
ovp_rs422_3 -- GPS03;
ovp_12v -- GPS03;
GPS03 -- lp [label="SMA-male/N-female"];
}
antenna [label="GPS Antenna"];
antenna -- lp [label="RG58 white / N-female"];
rack [label="Rack in DC"];
rack -- rj45splitter [label="CAT5"];
}
}}
h2. Software
* Like in the current hub at @laforge's basement, we should run the entire yate / osmo-e1d / dahdi-trunkdev inside a KVM with SRV-IO mapping the PCI devices
h2. Network
h2. Public IP
|_.Host|_.IPv4|_.IPv6|_.IPv4-internal|
|avst|213.95.46.30|?|192.168.7.129/25|
|divf|213.95.46.31|?|192.168.7.130/25|
|as5400|213.95.46.29|?|192.168.7.133|
|pm3|-|-|192.168.7.132|
|icE1-apu|-|-|192.168.7.131|
|grafana|-|-|192.168.7.134|
|avst-bmc|213.95.46.28|?|-|
h2. Misc / TODO
h3. local verification with modem/ISDN-TA
It would be great if we could somehow verify local calls via the yate / hub excluding the complexity of the TDMoIP to compare calls without TDMoIP to calls with TDMoIP.
Unfortuantely I'm not aware of any really small PBX that would terminate the E1/S2M and offer S0/POTS ports. Adding antoher 3U for a PBX seems excessive.
Doing calls between PM3 and ASR5400 is of course an option, but ideally we'd have a real physical modem attached via a serial port, and a real HFC-S-USB for test purpose.
h2. High-level parameters for data centre
* 7U rackspace
* 7x AC power outlet
* 7x Ethernet switch port (one of which supports 10 MBps!)
** some ports in a new VLAN
** some ports in an existing VLAN of my other servers in Rack 1120
* 1x CAT5 between rack and roof
* about 10cm of space on DIN-rail on roof enclosure (to mount OVP + GPS03)
h2. Questions
* Required antenna cable length between rooftop enclosure and antenna
* Mechanical antenna mounting details
* detailed switch port / VLAN config
