Project

General

Profile

Colocated Hub » History » Version 20

laforge, 09/23/2022 08:38 AM

1 2 laforge
{{>toc}}
2
3 1 laforge
h1. Colocated Hub
4
5 20 laforge
This page existed to collect planning about the future (Sept 2022) colocated OCTOI hub, see #5542
6 2 laforge
7 14 laforge
h2. Block Diagrams
8
9
h3. E1/TDM network
10
11
{{graphviz_link()
12
graph G {
13
  subgraph cluster_colo {
14
    label = "Co-Located Hub";
15
    divf [label="DIVF\nCentral Switch",shape="house"];
16
    icE1usb;
17
    pm3 [label="Livingston Portmaster 3"];
18
    as54 [label="Cisco AS5400"];
19
    icE1usb -- divf [label="E1 (timing master)"];
20
    pm3 -- divf [label="E1"];
21 20 laforge
    as54 -- divf [label="7xE1"];
22 14 laforge
  }
23
  divf -- laforge [label="TDMoIP"];
24
  divf -- manawyrm [label="TDMoIP"];
25
  divf -- gruetzkopf [label="TDMoIP"];
26
  divf -- roox [label="TDMoIP"];
27
  divf -- DrDeke [label="TDMoIP"];
28
  etc [label="other users..."];
29
  divf -- etc [label="TDMoIP"];
30
}
31
}}
32
33 15 laforge
h3. IP network
34
35
{{graphviz_link()
36
graph G {
37
  subgraph cluster_colo {
38
    label = "Co-Located Hub";
39
    vlan [label="VLAN/Switch",shape="rect"];   
40
    divf [label="DIVF\nCentral Switch",shape="house"];
41
    apu [label="APU (hosting icE1usb)"];
42
    pm3 [label="Livingston Portmaster 3"];
43
    as54 [label="Cisco AS5400"];
44
45
46
    vlan -- divf;
47
    vlan -- apu;
48
    vlan -- pm3;
49
    vlan -- as54;
50
  }
51
  lakshmi [label="Firewall\n(lakshmi)"];
52
  public_v4 [label="Internet (IPv4)"];
53
  public_v6 [label="Internet (IPv6)"];
54 17 laforge
  divf -- lakshmi [label="VLAN 257"];
55 15 laforge
  lakshmi -- public_v4;
56
  lakshmi -- public_v6;
57
}
58
}}
59 14 laforge
60 4 laforge
h2. Rackmount units
61 1 laforge
62 4 laforge
h3. Central Office server (2U / 67cm)
63 1 laforge
64 4 laforge
This is a 2U rack-mount server running all the relevant software.
65 1 laforge
66 4 laforge
See [[AVSt_Server]] for more details of the server
67 1 laforge
68 4 laforge
h4. Connections
69 1 laforge
70 4 laforge
This is a 2U rack-mount server with the following connections:
71
* Power
72 10 laforge
** 2x AC power connections (redundant PSU)
73 4 laforge
* Ethernet
74
** 1x RJ45 100-Base-TX BMC
75
** 2x RJ45 1000-Base-TX
76
* E1
77 20 laforge
** 87 E1 to a co-located Cisco AS5400 (see below)
78 4 laforge
** 1x E1 to a co-located Livingston PM3 (see below)
79
** 1x E1 to icE1usb/clock-source
80 20 laforge
** 2x E1 used with loop-back cable to provide proper timing from master card to slave card (timing cable has residual clock drift)
81 1 laforge
82
83 4 laforge
h3. icE1usb / E1 clock source (1U / 31cm)
84 1 laforge
85 4 laforge
This is a 1U rack mount system containing:
86
* a PC-Engines APU3 embedded x86_64
87
* an [[e1-t1-adapter:ICE40_E1_USB_interface|icE1usb]] with a custom RS422 interface board
88
* a custom rs422 over voltage protection + 12V injection board
89 1 laforge
90 4 laforge
This icE1usb acts as a GPS-disciplined clock master.  However, as no acutal RF GPS signal is available in the data centre, we are using an Ericsson [[ericsson-rbs-6xxx:GPS_02]] attached via ~100m of RS-422.
91 1 laforge
92 4 laforge
h4. Connections
93 1 laforge
94 4 laforge
* Power
95
** 2x AC power connections (1x APU, 1x RS422/GPS)
96
* Ethernet
97 8 laforge
** 1x RJ45 to internal VLAN
98 4 laforge
* RS422
99 1 laforge
** 1x RJ45 towards GPS02 on the roof
100
101 4 laforge
h3. Cisco AS5400 RAS Server (2U / 49cm)
102 1 laforge
103 4 laforge
h4. Connections
104 1 laforge
105 4 laforge
* Power
106
** 2x AC power connection (redundant PSU)
107
* Ethernet
108
** 1x RJ45 Ethernet (100-Base-TX) to internal VLAN
109
* E1
110
** 8x E1 (via break-out cable) to AVSt-Server
111 7 laforge
* RS232
112
** Serial console connection via USB-UART to [[AVSt_Server]]
113 4 laforge
114
h3. Livingstion Portmaster 3 (2U / 31cm)
115
116
h4. Connections
117
118
* Power
119
** 1x AC power connection
120
* Ethernet
121 9 laforge
** 1x RJ45 Ethernet (10-Base-TX) [yes, 10MBps] to internal VLAN
122 4 laforge
* E1
123
** 1x E1 to AVSt-Server
124 6 laforge
* RS232
125
** Serial console connection via USB-UART to [[AVSt_Server]]
126 4 laforge
127
h2. Roof installation
128
129
130
On the roof of the data centre, the CAT5 cable with RS422 for the GPS03 arrives.
131
132
It will be passed through several DIN rail mounted OVP (Over Voltage Protection) circuits before  connecting to the actual DIN-rail mounted Ericsson GPS03
133
134
The Ericsson GPS03 has a SMA connector, to which a SMA-male to N-Male coaxial cable is attached.
135
136
A Times Microwave LP-GTR-NFF lightning protector (N-female to N-femaile) is used to pass the coaxial cable through the enclosure
137
138
An external GPS antenna with N connector is plugged into the LP-GTR-NFF
139 1 laforge
140 5 laforge
h3. Overview diagram
141 1 laforge
142 5 laforge
This diagram illustrates the parts and connections on the rooftop.  Rectangular objects are DIN-rail mounted.
143 1 laforge
144 5 laforge
{{graphviz_link()
145
graph G {
146
  subgraph cluster_1 {
147
    label="Rooftop enclosure";
148
    rj45splitter [label="RJ45 splitter"];
149
    GPS03 [label="Ericsson GPS03", shape=rect];
150
    ovp_rs422_1 [shape=rect];
151
    ovp_rs422_2 [shape=rect];
152
    ovp_rs422_3 [shape=rect];
153
    ovp_12v [shape=rect];
154
    lp [label="LP-GTR-NFF"];
155
    rj45splitter -- ovp_rs422_1;
156
    rj45splitter -- ovp_rs422_2;
157
    rj45splitter -- ovp_rs422_3;
158
    rj45splitter -- ovp_12v;
159
    ovp_rs422_1 -- GPS03;
160
    ovp_rs422_2 -- GPS03;
161
    ovp_rs422_3 -- GPS03;
162
    ovp_12v -- GPS03;
163
    GPS03 -- lp [label="SMA-male/N-female"];
164
  }
165
  antenna [label="GPS Antenna"];
166
  antenna -- lp [label="RG58 white / N-female"];
167
  rack [label="Rack in DC"];
168
  rack -- rj45splitter [label="CAT5"];
169
}
170
}}
171 2 laforge
172 1 laforge
h2. Software
173
174 3 laforge
* Like in the current hub at @laforge's basement, we should run the entire yate / osmo-e1d / dahdi-trunkdev inside a KVM with SRV-IO mapping the PCI devices
175
176 16 laforge
h2. Network
177
178
h2. Public IP
179
180
|_.Host|_.IPv4|_.IPv6|_.IPv4-internal|
181
|avst|213.95.46.30|?|192.168.7.129/25|
182
|divf|213.95.46.31|?|192.168.7.130/25|
183
|as5400|213.95.46.29|?|192.168.7.133|
184
|pm3|-|-|192.168.7.132|
185
|icE1-apu|-|-|192.168.7.131|
186 19 laforge
|grafana|-|-|192.168.7.134|
187 16 laforge
|avst-bmc|213.95.46.28|?|-|
188 3 laforge
189
h2. Misc / TODO
190
191
h3. local verification with modem/ISDN-TA
192
193
It would be great if we could somehow verify local calls via the yate / hub excluding the complexity of the TDMoIP to compare calls without TDMoIP to calls with TDMoIP.
194
195
Unfortuantely I'm not aware of any really small PBX that would terminate the E1/S2M and offer S0/POTS ports.  Adding antoher 3U for a PBX seems excessive.
196
197 1 laforge
Doing calls between PM3 and ASR5400 is of course an option, but ideally we'd have a real physical modem attached via a serial port, and a real HFC-S-USB for test purpose.
198 11 laforge
199
h2. High-level parameters for data centre
200
201
* 7U rackspace
202
* 7x AC power outlet
203 13 laforge
* 7x Ethernet switch port (one of which supports 10 MBps!)
204 11 laforge
** some ports in a new VLAN
205
** some ports in an existing VLAN of my other servers in Rack 1120
206
* 1x CAT5 between rack and roof
207
* about 10cm of space on DIN-rail on roof enclosure (to mount OVP + GPS03)
208
209
h2. Questions
210 1 laforge
211 12 laforge
* Required antenna cable length between rooftop enclosure and antenna
212
* Mechanical antenna mounting details
213 11 laforge
* detailed switch port / VLAN config
Add picture from clipboard (Maximum size: 48.8 MB)