Project

General

Profile

Colocated Hub » History » Version 18

laforge, 09/23/2022 08:10 AM

1 2 laforge
{{>toc}}
2
3 1 laforge
h1. Colocated Hub
4
5 4 laforge
This page exists to collect planning about the future colocated OCTOI hub, see #5542
6 2 laforge
7 14 laforge
h2. Block Diagrams
8
9
h3. E1/TDM network
10
11
{{graphviz_link()
12
graph G {
13
  subgraph cluster_colo {
14
    label = "Co-Located Hub";
15
    divf [label="DIVF\nCentral Switch",shape="house"];
16
    icE1usb;
17
    pm3 [label="Livingston Portmaster 3"];
18
    as54 [label="Cisco AS5400"];
19
    icE1usb -- divf [label="E1 (timing master)"];
20
    pm3 -- divf [label="E1"];
21
    as54 -- divf [label="8xE1"];
22
  }
23
  divf -- laforge [label="TDMoIP"];
24
  divf -- manawyrm [label="TDMoIP"];
25
  divf -- gruetzkopf [label="TDMoIP"];
26
  divf -- roox [label="TDMoIP"];
27
  divf -- DrDeke [label="TDMoIP"];
28
  etc [label="other users..."];
29
  divf -- etc [label="TDMoIP"];
30
}
31
}}
32
33 15 laforge
h3. IP network
34
35
{{graphviz_link()
36
graph G {
37
  subgraph cluster_colo {
38
    label = "Co-Located Hub";
39
    vlan [label="VLAN/Switch",shape="rect"];   
40
    divf [label="DIVF\nCentral Switch",shape="house"];
41
    apu [label="APU (hosting icE1usb)"];
42
    pm3 [label="Livingston Portmaster 3"];
43
    as54 [label="Cisco AS5400"];
44
45
46
    vlan -- divf;
47
    vlan -- apu;
48
    vlan -- pm3;
49
    vlan -- as54;
50
  }
51
  lakshmi [label="Firewall\n(lakshmi)"];
52
  public_v4 [label="Internet (IPv4)"];
53
  public_v6 [label="Internet (IPv6)"];
54 17 laforge
  divf -- lakshmi [label="VLAN 257"];
55 15 laforge
  lakshmi -- public_v4;
56
  lakshmi -- public_v6;
57
}
58
}}
59 14 laforge
60 4 laforge
h2. Rackmount units
61 1 laforge
62 4 laforge
h3. Central Office server (2U / 67cm)
63 1 laforge
64 4 laforge
This is a 2U rack-mount server running all the relevant software.
65 1 laforge
66 4 laforge
See [[AVSt_Server]] for more details of the server
67 1 laforge
68 4 laforge
h4. Connections
69 1 laforge
70 4 laforge
This is a 2U rack-mount server with the following connections:
71
* Power
72 10 laforge
** 2x AC power connections (redundant PSU)
73 4 laforge
* Ethernet
74
** 1x RJ45 100-Base-TX BMC
75
** 2x RJ45 1000-Base-TX
76
* E1
77
** 8x E1 to a co-located Cisco AS5400 (see below)
78
** 1x E1 to a co-located Livingston PM3 (see below)
79
** 1x E1 to icE1usb/clock-source
80 1 laforge
81
82 4 laforge
h3. icE1usb / E1 clock source (1U / 31cm)
83 1 laforge
84 4 laforge
This is a 1U rack mount system containing:
85
* a PC-Engines APU3 embedded x86_64
86
* an [[e1-t1-adapter:ICE40_E1_USB_interface|icE1usb]] with a custom RS422 interface board
87
* a custom rs422 over voltage protection + 12V injection board
88 1 laforge
89 4 laforge
This icE1usb acts as a GPS-disciplined clock master.  However, as no acutal RF GPS signal is available in the data centre, we are using an Ericsson [[ericsson-rbs-6xxx:GPS_02]] attached via ~100m of RS-422.
90 1 laforge
91 4 laforge
h4. Connections
92 1 laforge
93 4 laforge
* Power
94
** 2x AC power connections (1x APU, 1x RS422/GPS)
95
* Ethernet
96 8 laforge
** 1x RJ45 to internal VLAN
97 4 laforge
* RS422
98 1 laforge
** 1x RJ45 towards GPS02 on the roof
99
100 4 laforge
h3. Cisco AS5400 RAS Server (2U / 49cm)
101 1 laforge
102 4 laforge
h4. Connections
103 1 laforge
104 4 laforge
* Power
105
** 2x AC power connection (redundant PSU)
106
* Ethernet
107
** 1x RJ45 Ethernet (100-Base-TX) to internal VLAN
108
* E1
109
** 8x E1 (via break-out cable) to AVSt-Server
110 7 laforge
* RS232
111
** Serial console connection via USB-UART to [[AVSt_Server]]
112 4 laforge
113
h3. Livingstion Portmaster 3 (2U / 31cm)
114
115
h4. Connections
116
117
* Power
118
** 1x AC power connection
119
* Ethernet
120 9 laforge
** 1x RJ45 Ethernet (10-Base-TX) [yes, 10MBps] to internal VLAN
121 4 laforge
* E1
122
** 1x E1 to AVSt-Server
123 6 laforge
* RS232
124
** Serial console connection via USB-UART to [[AVSt_Server]]
125 4 laforge
126
h2. Roof installation
127
128
129
On the roof of the data centre, the CAT5 cable with RS422 for the GPS03 arrives.
130
131
It will be passed through several DIN rail mounted OVP (Over Voltage Protection) circuits before  connecting to the actual DIN-rail mounted Ericsson GPS03
132
133
The Ericsson GPS03 has a SMA connector, to which a SMA-male to N-Male coaxial cable is attached.
134
135
A Times Microwave LP-GTR-NFF lightning protector (N-female to N-femaile) is used to pass the coaxial cable through the enclosure
136
137
An external GPS antenna with N connector is plugged into the LP-GTR-NFF
138 1 laforge
139 5 laforge
h3. Overview diagram
140 1 laforge
141 5 laforge
This diagram illustrates the parts and connections on the rooftop.  Rectangular objects are DIN-rail mounted.
142 1 laforge
143 5 laforge
{{graphviz_link()
144
graph G {
145
  subgraph cluster_1 {
146
    label="Rooftop enclosure";
147
    rj45splitter [label="RJ45 splitter"];
148
    GPS03 [label="Ericsson GPS03", shape=rect];
149
    ovp_rs422_1 [shape=rect];
150
    ovp_rs422_2 [shape=rect];
151
    ovp_rs422_3 [shape=rect];
152
    ovp_12v [shape=rect];
153
    lp [label="LP-GTR-NFF"];
154
    rj45splitter -- ovp_rs422_1;
155
    rj45splitter -- ovp_rs422_2;
156
    rj45splitter -- ovp_rs422_3;
157
    rj45splitter -- ovp_12v;
158
    ovp_rs422_1 -- GPS03;
159
    ovp_rs422_2 -- GPS03;
160
    ovp_rs422_3 -- GPS03;
161
    ovp_12v -- GPS03;
162
    GPS03 -- lp [label="SMA-male/N-female"];
163
  }
164
  antenna [label="GPS Antenna"];
165
  antenna -- lp [label="RG58 white / N-female"];
166
  rack [label="Rack in DC"];
167
  rack -- rj45splitter [label="CAT5"];
168
}
169
}}
170 2 laforge
171 1 laforge
h2. Software
172
173 3 laforge
* Like in the current hub at @laforge's basement, we should run the entire yate / osmo-e1d / dahdi-trunkdev inside a KVM with SRV-IO mapping the PCI devices
174
175 16 laforge
h2. Network
176
177
h2. Public IP
178
179
|_.Host|_.IPv4|_.IPv6|_.IPv4-internal|
180
|avst|213.95.46.30|?|192.168.7.129/25|
181
|divf|213.95.46.31|?|192.168.7.130/25|
182
|as5400|213.95.46.29|?|192.168.7.133|
183
|pm3|-|-|192.168.7.132|
184
|icE1-apu|-|-|192.168.7.131|
185 18 laforge
|grafana|-|-|192.168.7.132|
186 16 laforge
|avst-bmc|213.95.46.28|?|-|
187 3 laforge
188
h2. Misc / TODO
189
190
h3. local verification with modem/ISDN-TA
191
192
It would be great if we could somehow verify local calls via the yate / hub excluding the complexity of the TDMoIP to compare calls without TDMoIP to calls with TDMoIP.
193
194
Unfortuantely I'm not aware of any really small PBX that would terminate the E1/S2M and offer S0/POTS ports.  Adding antoher 3U for a PBX seems excessive.
195
196 1 laforge
Doing calls between PM3 and ASR5400 is of course an option, but ideally we'd have a real physical modem attached via a serial port, and a real HFC-S-USB for test purpose.
197 11 laforge
198
h2. High-level parameters for data centre
199
200
* 7U rackspace
201
* 7x AC power outlet
202 13 laforge
* 7x Ethernet switch port (one of which supports 10 MBps!)
203 11 laforge
** some ports in a new VLAN
204
** some ports in an existing VLAN of my other servers in Rack 1120
205
* 1x CAT5 between rack and roof
206
* about 10cm of space on DIN-rail on roof enclosure (to mount OVP + GPS03)
207
208
h2. Questions
209 1 laforge
210 12 laforge
* Required antenna cable length between rooftop enclosure and antenna
211
* Mechanical antenna mounting details
212 11 laforge
* detailed switch port / VLAN config
Add picture from clipboard (Maximum size: 48.8 MB)