BSI PD IEC TR 61850-90-12:2020
$215.11
Communication networks and systems for power utility automation – Wide area network engineering guidelines
Published By | Publication Date | Number of Pages |
BSI | 2020 | 264 |
This part of IEC 61850, which is a Technical Report, is intended for an audience familiar with electrical power automation based on IEC 61850 and related power system management, and particularly for data network engineers and system integrators. It is intended to help them to understand the technologies, configure a wide area network, define requirements, write specifications, select components, and conduct tests.
This document provides definitions, guidelines, and recommendations for the engineering of WANs, in particular for protection, control and monitoring based on IEC 61850 and related standards.
This document addresses substation-to-substation communication, substation-to-control centre, and control centre-to-control centre communication. In particular, this document addresses the most critical aspects of IEC 61850 such as protection related data transmission via GOOSE and SMVs, and the multicast transfer of large volumes of synchrophasor data.
The document addresses issues such as topology, redundancy, traffic latency and quality of service, traffic management, clock synchronization, security, and maintenance of the network.
This document contains use cases that show how utilities tackle their WAN engineering.
PDF Catalog
PDF Pages | PDF Title |
---|---|
2 | undefined |
4 | CONTENTS |
14 | FOREWORD |
16 | INTRODUCTION |
18 | 1 Scope 2 Normative references |
23 | 3 Terms, definitions, abbreviated terms, acronyms, and symbols 3.1 Terms and definitions |
27 | 3.2 Abbreviated terms and acronyms |
36 | 3.3 Network diagram symbols |
37 | Figures Figure 1 – Symbols |
38 | 4 Wide area communication in electrical utilities 4.1 Executive summary |
40 | 4.2 Network and application example: ENDESA, Andalusia (Spain) Figure 2 – Substation locations in Andalusia |
41 | Figure 3 – Topology of the Andalusia network |
42 | 4.3 Typical interface between a substation and the WAN Figure 4 – Cabinet of a substation edge node |
43 | 4.4 WAN characteristics and actors Figure 5 – Communication interfaces in a SEN |
44 | 4.5 Smart Grid Architecture Model (SGAM) Mapping Figure 6 – Communicating entities |
45 | Figure 7 – SGAM communication model |
46 | 4.6 Network elements and voltage level Figure 8 – Principle of grid voltage level and network technology |
47 | 4.7 WAN interfaces in substation automation (IEC 61850-5) Figure 9 – Communication paths and interfaces |
48 | 4.8 Logical interfaces and protocols in the architecture in IEC TR 62357-200 Figure 10 – IEC TR 62357 Interfaces, protocols, and applications |
49 | 4.9 Network traffic and ownership |
50 | 5 WAN metrics 5.1 Traffic types 5.2 Quality of Service (QoS) of TDM and PSN 5.3 Latency calculation 5.3.1 Latency components |
51 | 5.3.2 Propagation delay 5.3.3 Residence delay 5.3.4 Latency accumulation 5.3.5 Example: latency of a microwave system Figure 11 – Composition of end-to-end latency in a microwave relay |
52 | 5.3.6 Latency and determinism 5.3.7 Latency classes in IEC 61850-5 Figure 12 – Example of latency in function of traffic |
53 | Tables Table 1 – Latency classes in IEC 61850-5 Table 2 – Latency classes in IEC TR 61850-90-1 |
54 | 5.4 Jitter 5.4.1 Jitter definition Figure 13 – Jitter for two communication delay types Table 3 – Latency classes for WANs |
55 | 5.4.2 Jitter classes in IEC 61850 5.5 Latency symmetry and path congruency 5.6 Medium asymmetry Table 4 – Jitter classes in IEC TR 61850-90-1 Table 5 – Jitter classes for WAN |
56 | 5.7 Communication speed symmetry 5.8 Recovery delay 5.9 Time accuracy 5.9.1 Time accuracy definition Table 6 – Recovery delay classes for WAN |
57 | 5.9.2 Time accuracy classes Figure 14 – Precision and accuracy definitions Table 7 – IEC TR 61850-90-1 time accuracy classes |
58 | 5.10 Tolerance against failures 5.10.1 Failure Table 8 – IEC 61850-5 time accuracy classes for IED synchronization Table 9 – WAN time synchronization classes |
59 | 5.10.2 Reliability 5.10.3 Redundancy principles |
60 | 5.10.4 Redundancy and reliability Figure 15 – Redundancy of redundant systems |
61 | 5.10.5 Redundancy checking 5.10.6 Redundant layout: single point of failure Figure 16 – Redundancy calculation Figure 17 – Redundancy layout with single point of failure |
62 | 5.10.7 Redundant layout: cross-redundancy Figure 18 – Redundancy layout with cross-coupling |
63 | 5.10.8 Maintainability 5.10.9 Availability Figure 19 – Availability definitions |
65 | 5.10.10 Integrity Figure 20 – Residual error rate as a function of BER |
66 | 5.10.11 Dependability 5.10.12 Example: Dependability of GOOSE transmission |
67 | 6 Use cases and WAN communication requirements 6.1 List of generic use cases |
68 | 6.2 Teleprotection (IF2 & IF11) 6.2.1 Teleprotection schemes 6.2.2 Teleprotection data kinds 6.2.3 Current differential teleprotection for multi-terminal transmission line |
69 | 6.2.4 Teleprotection communication requirements Figure 21 – Network configurations for multi-terminal line protection |
70 | Table 10 – Latency for line protection Table 11 – Summary of operational requirements of line protection |
71 | 6.3 Wide area monitoring system (IF13) 6.3.1 WAMS overview Table 12 – Summary of communication requirements for teleprotection |
72 | 6.3.2 WAMS topology |
73 | Figure 22 – Principle of synchrophasor transmission |
74 | 6.3.3 WAMS communication requirements Figure 23 – PMUs and data flow between TSO and regional data hubs |
75 | Table 13 – Summary of synchrophasor requirements |
76 | 6.4 Wide area monitoring, protection, and control (WAMPAC) IF13 6.4.1 Functional description Figure 24 – Target phenomena for WAMPAC Table 14 – Summary of communication requirements for wide area monitoring |
77 | Figure 25 – Example of main function and general information flow |
78 | 6.4.2 WAMPAC communication requirements 6.5 Fault Location 6.5.1 Functional description Table 15 – Typical communication requirements for WAMPAC |
79 | Figure 26 – Network configuration for a fault locator system |
80 | 6.5.2 Fault location communication requirements 6.6 Distribution Automation 6.6.1 Functional description Table 16 – Requirements for fault location |
81 | 6.6.2 Distribution automation communication requirements Figure 27 – System configuration for distribution automation Table 17 – Requirements for distribution automation communication |
82 | 6.7 Condition monitoring and diagnostics (CMD) and asset management (IF7) 6.7.1 Functional description 6.7.2 CMD communication requirements Figure 28 – Network configurations for CMD and asset management Table 18 – Communication requirements for CMD |
83 | 6.8 Telecontrol (SCADA) 6.8.1 Functional description 6.8.2 Telecontrol communication requirements Figure 29 – Logical network configuration for telecontrol (SCADA) |
84 | 6.9 Control centre to control centre (IF12) 6.9.1 Functional description Table 19 – Communication requirements for CC to SS/PS Table 20 – Latency and timing requirements from IEC TR 61850-90-2 |
85 | 6.9.2 Inter control centre communication requirements Figure 30 – Network configurations for inter-control centre Table 21 – Communication requirements for inter-control centre communications |
86 | 6.10 Smart metering / advanced metering infrastructure 6.10.1 Functional description 6.10.2 Smart metering communication requirements Figure 31 – System configuration for smart metering Table 22 – Requirements for smart metering communication |
87 | 6.11 WAN communication requirements summary Table 23 – Classification of communication requirements |
88 | 7 Wide-area and real-time network technologies 7.1 General 7.2 Topology Table 24 – Communication requirements of wide-area applications |
89 | 7.3 Overview Figure 32 – Network ring topology example |
90 | Table 25 – Communication technologies |
91 | 7.4 Layer 1 (physical) transmission media 7.4.1 Summary 7.4.2 Installation guidelines 7.4.3 Metallic lines Table 26 – Physical communication media |
92 | Table 27 – DSL communication over twisted pairs Table 28 – Trade-offs in copper cable communication |
93 | 7.4.4 Power line carrier (PLC) Table 29 – Power Line Telecommunication advantages and disadvantages |
94 | Table 30 – HF spectrum allocated for HV/MV PLC systems Table 31 – HF spectrum used for narrowband LV PLC and associated standards |
95 | Figure 33 – Narrowband channel plans for LV PLC Europe vs. North America Figure 34 – HF allocated frequency spectrum plans for LV BPL |
96 | Figure 35 – Narrowband spectrum usage vs. standards and regulation areas [57] |
97 | Table 32 – Characteristics of common NB-PLC standards |
98 | Figure 36 – HV PLC link building blocks |
99 | Figure 37 – Phase-to-ground coupling for PLC Figure 38 – HV PLC coupling with suspended line traps |
100 | Figure 39 – Phase-to-phase signal coupling for PLC Figure 40 – Phase-to-phase signal coupling |
101 | Figure 41 – Power line carrier, line traps |
103 | 7.4.5 Radio transmission Table 33 – HV/MV APLC/DPLC/BPL technology performance |
104 | Figure 42 – Terrestrial microwave link |
105 | Figure 43 – Layer 2 transport on microwave radio systems Table 34 – Microwave link performance |
106 | Table 35 – Terrestrial microwave advantages and disadvantages Table 36 – Terrestrial mobile radio technologies |
107 | Table 37 – Terrestrial radio advantages and disadvantages |
108 | Figure 44 – DMR (Digital Mobile Radio) Table 38 – DMR advantages and disadvantages |
109 | Table 39 – Satellite radio advantages and disadvantages |
110 | Figure 45 – LoRaWANTM Protocol Stack |
112 | Table 40 – LPWAN technology capabilities |
113 | Table 41 – Wireless technologies used for customer-side communications in Japan |
114 | 7.4.6 Fibre optics |
115 | Figure 46 – ADSS fibre cable Figure 47 – ADSS installation with splicing box |
116 | Figure 48 – OPGW in ground cable Figure 49 – OPGW with two “C”-tubes each with 32 fibers |
117 | Figure 50 – OPGW fibers |
118 | Figure 51 – Splicing box |
119 | Figure 52 – WDM over one fibre Figure 53 – OCh optical components |
120 | 7.4.7 Layer 1 redundancy Table 42 – Optical fibres: advantages and disadvantages |
121 | 7.4.8 Application example: diverse redundancy against extreme contingencies (Hydro-Quebec) Figure 54 – Optical link with microwave back-up |
122 | 7.4.9 Layer 1 security 7.5 Layer 1,5 (physical) multiplexing Figure 55 – Photograph of a partially destroyed 735 kV line |
123 | 7.6 Layer 2 (link) technologies 7.6.1 Telephony technologies |
124 | Figure 56 – E1 and E2 channels Figure 57 – Digital transmission hierarchy (T-standards) |
125 | 7.6.2 SDH/SONET Figure 58 – Digital transmission hierarchy (E-standard) |
126 | Figure 59 – Example of an SDH network for utilities |
127 | Figure 60– SONET multiplexing hierarchy Figure 61 – SDH multiplexing hierarchy |
128 | Table 43 – SONET and SDH hierarchies |
129 | Figure 62 – SDH/SONET with point-to-point topology Figure 63 – SDH/SONET with linear topology |
131 | Figure 64 – BLSR/BSHR topology in normal conditions (from A to D) Figure 65 – BLSR/BSHR topology in failure conditions |
132 | Figure 66 – SNCP/UPSR topology in normal conditions |
133 | Figure 67 – SNCP/UPSR topology in failure conditions |
135 | 7.6.3 Optical Transport Network Table 44 – Summary of SDH/SONET |
136 | Figure 68 – Example of information flow relationship in OTN |
137 | 7.6.4 Ethernet Figure 69 – IEEE 802.3 (Ethernet) frame format Table 45 – Ethernet physical layers |
138 | Figure 70 – IEEE 802.3 (Ethernet) topology with RSTP switches |
139 | Figure 71 – IEEE 802.1Q-tagged Ethernet frame format |
140 | Figure 72 – Direct Ethernet with VLAN in substation-to-substation transmission |
141 | Figure 73 – Substation-to-substation Layer 2 transmission tunnelled over IP |
142 | Figure 74 – PRP structure (within and outside a substation) |
143 | Figure 75 – HSR ring connecting substations and control centre |
144 | Figure 76 – MACsec frame format |
145 | Figure 77 – IEEE 802.1X principle |
146 | 7.6.5 Ethernet over TDM Figure 78 – Ethernet for substation-to-substation communication |
147 | Figure 79 – Packets over TDM Table 46 – Payload mapping using SDH/SONET and Next Generation SDH/SONET |
148 | 7.6.6 Carrier Ethernet |
149 | 7.6.7 Audio-video bridging 7.6.8 Provider Backbone Bridge (PBB) Table 47 – Carrier Ethernet summary |
150 | Figure 80 – IEEE 802.1Q/ad/ah network configuration |
151 | 7.6.9 Multiprotocol Label Switching (MPLS) |
152 | Figure 81 – Basic MPLS architecture Figure 82 – Example of MPLS frame format with IPv4 payload |
153 | Figure 83 – MPLS building blocks |
155 | Figure 84 – MPLS network architecture for utilities |
156 | Figure 85 – IP/MPLS and MPLS-TP features Table 48 – IP/MPLS characteristics |
157 | Table 49 – MPLS-TP characteristics |
158 | Figure 86 – MPLS-TP redundant routing Table 50 – MPLS summary |
159 | 7.7 Layer 3 (network) technologies 7.7.1 Internet Protocol (IP) Figure 87 – Ethernet frame with IP network header |
160 | Figure 88 – Mapping of IPv4 to Ethernet frames |
163 | Figure 89 – Mapping of IPv6 to Ethernet frames |
164 | Figure 90 – IPv6 unicast address structure |
165 | Figure 91 – IPv6 ULA address structure Figure 92 – IPv6 link local address structure |
166 | Table 51 – Differences between IPv4 and IPv6 |
167 | Table 52 – IPv6 vs IPv4 addresses (RFC 4291) |
168 | Figure 93 – Mapping of IPv4 to IPv6 addresses |
169 | 7.7.2 IP QoS |
171 | Figure 94 – DiffServ codepoint field Table 53 – List of DiffServ codepoint field values |
172 | 7.7.3 IP multicast Figure 95 – Unidirectional protocol independent multicast |
173 | 7.7.4 IP redundancy 7.7.5 IP security Figure 96 – Bidirectional protocol independent multicast |
174 | Figure 97 – Frame format for IPsec (authenticated) Figure 98 – Frame format for IPsec (encrypted) |
175 | 7.7.6 IP communication for utilities Figure 99 – Layer 3 direct connection within same address space |
176 | Figure 100 – Connecting substations to SCADA by a NAT |
177 | 7.7.7 IP summary Figure 101 – Substation to SCADA connection over ALG Table 54 – IP Summary |
178 | 7.8 Layer 4 (transport) protocols 7.8.1 Transport layer encapsulation 7.8.2 UDP Figure 102 – Ethernet frame with UDP transport layer |
179 | 7.8.3 TCP Figure 103 – UDP header Figure 104 – TCP header |
180 | 7.8.4 Layer 4 redundancy 7.8.5 Layer 4 security 7.9 Layer 5 (session) and higher 7.9.1 Session layer |
181 | 7.9.2 Routable GOOSE and SMV 7.9.3 Example: C37.118 transmission Figure 105 – Session and presentation layers for MMS Figure 106 – Session and presentation layers for R-GOOSE |
182 | 7.9.4 Session protocol for voice and video transmission 7.9.5 Application interface redundancy Figure 107 – IEEE C37.118 frame over UDP Figure 108 – Redundant network transmission handled by the application layer |
183 | 7.9.6 Application device redundancy 7.10 Protocol overlay – tunnelling 7.10.1 Definitions |
184 | 7.10.2 Tunnelling principle 7.10.3 Tunnelling Layer 2 over Layer 3 Figure 109 – Tunnelling in IEC TR 61850-90-1 |
185 | 7.10.4 Application Example: Tunnelling GOOSE and SMV in IEC 61850 Figure 110 – L2TP transporting Layer 2 frames over IP |
186 | 7.11 Virtual private networks (VPNs) 7.11.1 VPN principles 7.11.2 L2VPNs Figure 111 – Tunneling SMV over IP in IEC TR 61850-90-5 |
187 | Figure 112 – L2VPNs VPWS and VPLS |
188 | 7.11.3 L2VPN multicast on MPLS 7.11.4 L3VPN Figure 113 – L3VPN |
190 | 7.11.5 VPN mapping to application Figure 114 – Emulation of L3VPN by L2VPN and global router |
191 | Table 55 – VPN services |
192 | Figure 115 – Tele-protection over VPWS Figure 116 – WAMS over VPLS |
193 | Figure 117 – VPN for IP-based SCADA/EMS traffic |
194 | 7.12 Cyber security 7.12.1 Security circles |
195 | 7.12.2 Network security |
196 | Figure 118 – VPN deployment options |
197 | 7.12.3 Access control 7.12.4 Threat detection and mitigation. |
198 | Figure 119 – IP network separator |
201 | 7.12.5 Security architecture |
202 | 7.12.6 Application (end-to-end) communication security Figure 120 – Security architecture (using segmentation and perimeter security) |
203 | 7.12.7 Security for synchrophasor (PMU) networks (IEC TR 61850-90-5) Table 56 – IEC 62351 series |
204 | 7.12.8 Additional recommendations 7.13 QoS and application-specific engineering 7.13.1 General 7.13.2 SDH/SONET QoS and SLA 7.13.3 PSN QoS and SLA |
205 | 7.13.4 Application and priority 7.13.5 QoS chain between networks Table 57 – Example of simple application priority assignment |
206 | 7.13.6 QoS mapping between networks Figure 121 – QoS chain |
207 | 7.13.7 QoS engineering |
208 | 7.13.8 Customer restrictions 7.13.9 Clock services 7.14 Configuration and OAM 7.14.1 Network configuration 7.14.2 OAM |
210 | 7.15 Time synchronization 7.15.1 Oscillator stability Table 58 – Typical oscillator stability |
211 | 7.15.2 Mutual synchronization 7.15.3 Direct synchronization Figure 122 – Timing pulse transmission methods of legacy teleprotection devices |
212 | 7.15.4 Radio synchronization 7.15.5 GNSS synchronization 7.15.6 Frequency distribution |
213 | Figure 123 – SyncE application Figure 124 – Synchronous Ethernet architecture |
214 | 7.15.7 Time distribution |
215 | Figure 125 – SNTP clock synchronization and network delay measurement |
218 | Figure 126 – Model of GMC, two BCs in series and SC over Layer 3 Figure 127 – Timing diagram of PTP (end-to-end, 2-step, TC and BC) |
219 | Figure 128 – Timing diagram of PTP (peer-to-peer, 2-step TCs) Table 59 – IEC 61588 option comparison |
220 | 7.15.8 PTP telecommunication profiles |
221 | 7.15.9 PTP over MPLS 7.15.10 Comparison of time distribution profiles based on IEC 61588 Table 60 – Precision time distribution protocols based on IEC 61588 |
222 | 7.15.11 Application example: synchrophasor time synchronization |
223 | 7.15.12 Application example: Atomic clock hierarchy Figure 129 – Substations synchronization over WAN |
224 | 8 Technology mapping to applications 8.1 Overview 8.2 Current differential teleprotection for multi-terminal transmission lines 8.2.1 General Figure 130 – Example of synchronization network |
225 | 8.2.2 Deterministic fibre-optic PDH loop network 8.2.3 Dedicated Gigabit Ethernet network Figure 131 – Distributed loop configuration for HV multi-terminal line protection |
226 | 8.2.4 Carrier Ethernet with wide-area time synchronization Figure 132 – Current differential teleprotection for HV multi-terminaltransmission line using Layer 2 network |
227 | 8.2.5 MPLS based wide area network Figure 133 – Configuration of wide area current differential primary and backup teleprotection system employing Carrier Ethernet and IEC 61588 time synchronization |
228 | Figure 134 – Current differential protection communication via MPLS network |
229 | 8.3 Wide area monitoring, protection, and control (WAMPAC) 8.3.1 General 8.3.2 Wide area stabilizing control using legacy network |
230 | Figure 135 – System configuration for wide area stabilizing control system Figure 136 – Appearance of typical CCE cubicle |
231 | 8.3.3 PMU-based WAMPAC using time-synchronized Layer 2 and Layer 3 network Table 61 – Main system specifications for wide area stabilizing control system |
233 | 8.4 Fault location Table 62 – Main system specifications for PMU-based WAMPAC system |
234 | 8.5 SCADA and facility maintenance Figure 138 – IEEE 802.1Q/ad utility network |
235 | Figure 139 – Mixed SDH/MPLS network for SCADA and facility maintenance services Table 63 – Requirements for the YONDEN IP network Table 64 – Technologies for the YONDEN IP network |
236 | 8.6 Distribution automation 8.7 Smart metering Figure 140 – Wired technology solutions for distribution automation Figure 141 – Wireless technology solutions for distribution automation(Radio network in feeder automation) |
237 | Figure 142 – Multi-hop wireless system Figure 143 – NB-PLC system Figure 144 – Cellular services used for a low-density residential area |
238 | Figure 145 – WAN communication protocols for smart metering |
239 | 9 Network migration 9.1 TDM to packet switched network 9.1.1 General 9.1.2 Overview 9.1.3 Drivers for network migration |
240 | 9.1.4 Considerations for network migration |
242 | 9.1.5 Migration concepts |
245 | Figure 146 – Migration path from TDM to Packet in the Power Utility Operational Network |
246 | Figure 147 – Ethernet or MPLS beside SDH over separate fibre or wavelength Figure 148 – Ethernet or MPLS-TP and SDH in a Hybrid platform |
248 | 9.1.6 Implementation details |
249 | Figure 149 – Pseudo-wire principle |
250 | Figure 150 – Non-IP voice communication over PSN |
251 | Figure 151 – Circuit emulation over PSN |
252 | 9.2 From IPv4 to IPv6 9.2.1 IPv4 to IPv6 evolution 9.2.2 IPv4 to IPv6 migration Figure 152 – IPv6 evolution Table 65 – Pseudowire protocols |
253 | 9.2.3 IEC 61850 stack with IPv4 and IPv6 Figure 153 – IEC 61850 stack with IPv4 and IPv6 (doubly attached) |
254 | Annex A (informative)Future promising or upcoming technologies A.1 5G A.1.1 General |
255 | A.1.2 Different performance requirements Figure A.1 – Software network technologies in 5G overall architecture |
256 | Figure A.2 – 5G Conceptual Diagram – NGMN |
257 | Figure A.3 – NB-IOT deployment models Table A.1 – 3GPP machine type communications |
258 | A.2 Deterministic networking technologies |
259 | Bibliography |