EP4181478A1 - Verbesserung der kommunikation in einem industriellen automatisierungssystem - Google Patents
Verbesserung der kommunikation in einem industriellen automatisierungssystem Download PDFInfo
- Publication number
- EP4181478A1 EP4181478A1 EP21207761.4A EP21207761A EP4181478A1 EP 4181478 A1 EP4181478 A1 EP 4181478A1 EP 21207761 A EP21207761 A EP 21207761A EP 4181478 A1 EP4181478 A1 EP 4181478A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- communication
- activity
- endpoint device
- congestion
- data stream
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
- H04L47/11—Identifying congestion
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
- H04L47/22—Traffic shaping
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0876—Network utilisation, e.g. volume of load or congestion level
- H04L43/0882—Utilisation of link capacity
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
- G05B19/4185—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM] characterised by the network communication
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/50—Network service management, e.g. ensuring proper service fulfilment according to agreements
- H04L41/5003—Managing SLA; Interaction between SLA and QoS
- H04L41/5019—Ensuring fulfilment of SLA
- H04L41/5025—Ensuring fulfilment of SLA by proactively reacting to service quality change, e.g. by reconfiguration after service quality degradation or upgrade
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/06—Generation of reports
- H04L43/065—Generation of reports related to network devices
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0823—Errors, e.g. transmission errors
- H04L43/0829—Packet loss
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0852—Delays
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0852—Delays
- H04L43/087—Jitter
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
- H04L47/12—Avoiding congestion; Recovering from congestion
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
- H04L47/24—Traffic characterised by specific attributes, e.g. priority or QoS
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
- H04L47/24—Traffic characterised by specific attributes, e.g. priority or QoS
- H04L47/2416—Real-time traffic
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
- H04L47/28—Flow control; Congestion control in relation to timing considerations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
- H04L47/29—Flow control; Congestion control using a combination of thresholds
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
- H04L47/32—Flow control; Congestion control by discarding or delaying data units, e.g. packets or frames
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/30—Nc systems
- G05B2219/31—From computer integrated manufacturing till monitoring
- G05B2219/31244—Safety, reconnect network automatically if broken
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/16—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks using machine learning or artificial intelligence
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/50—Network service management, e.g. ensuring proper service fulfilment according to agreements
- H04L41/5003—Managing SLA; Interaction between SLA and QoS
- H04L41/5019—Ensuring fulfilment of SLA
- H04L41/5022—Ensuring fulfilment of SLA by giving priorities, e.g. assigning classes of service
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
Definitions
- the present invention relates to a method, arrangement, computer program and computer program product for improving communication between devices of an industrial automation system as well as to such an industrial automation system.
- TSN Time Sensitive Networking
- TSN promised to guarantee the timing requirements of time sensitive flows while still enabling the coexistence of different traffic types in the same network.
- a TSN network may be used for an industrial automation system, where different applications that have different timing requirement are being employed, which applications may additionally be process control applications.
- TSN network may become congested. It would in this case be of interest to perform activities that limit network congestion, especially with regard to the individual requirements of a specific application.
- aspects of the present invention are directed towards improving communication in an industrial automation system.
- This object is according to a first aspect archived through a method for improving communication between devices of an industrial automation system running automation applications, which devices comprise a first and a second endpoint device in of a communication path for a data stream through a time sensitive network and for which data stream a corresponding application has an application cycle time at which the first and second endpoint device are to transmit data to each other, the method comprising performing by the first endpoint device:
- the object is according to a second aspect archived through an arrangement for improving communication between devices of an industrial automation system running automation applications, which devices comprise a first and a second endpoint device of a communication path for a data stream through a time sensitive network and for which data stream a corresponding application has an application cycle time at which the first and second endpoint device are to transmit data to each other, the arrangement comprising the first endpoint device having a processor acting on computer instructions, whereby the first end point device is operative to:
- the object is according to a third aspect achieved through an industrial automation system comprising a time sensitive network, devices running automation applications and an arrangement according to the second aspect.
- the object is according to a fourth aspect achieved through a computer program for improving communication between devices of an industrial automation system running automation applications, which devices comprise a first and a second endpoint device of a communication path for a data stream through a time sensitive network and for which data stream a corresponding application has an application cycle time at which the first and second endpoint device are to transmit data to each other,
- the computer program comprising computer program code which when run by a processor of the first endpoint device causes the first endpoint device to:
- the object is according to a fifth aspect achieved through a computer program product for improving communication of an industrial automation system running automation applications, the computer program product comprising a storage medium with computer program code according to the fourth aspect.
- the first endpoint device may comprise a transmit buffer for transmission of data over the communication path.
- the group of activities may comprise an activity of adjusting an offset to a network clock of the time sensitive network, an activity of changing the priority of transmissions over the communication path, an activity of setting at least some packets intended to be transmitted over the communication path to be droppable, an activity of setting up an alternative communication path through the time sensitive network and/or and activity of throttling transmissions from the transmit buffer.
- the increasing of the application cycle time may first be made for a low priority data stream. It is furthermore possible that the increasing of the application cycle time is made in an order of priority starting from the data stream with the lowest priority. It is additionally possible that the increasing of the application cycle according to the order of priority is stopped if the communication degradation ceases.
- the first endpoint device may additionally comprise a receive buffer and the detecting of the communication degradation may be performed through investigating the receive buffer.
- the communication degradation may additionally be of a certain type, where a first type may be jitter, a second type may be latency and a third type may be dropped packets.
- the investigating of the receive buffer may comprise investigating if the periodicity of packets in the receive buffer deviate from a nominal periodicity.
- the investigating of the receive buffer may involve comparing time stamps of packets received in the receive buffer with the time of reception.
- the investigating of the receive buffer may involve investigating if one or more packets in a sequence of packets are absent in the receive buffer.
- the detecting of a communication degradation may additionally involve comparing the communication degradation with a threshold and considering the communication degradation as detected if the threshold is crossed.
- Jitter may be compared with a jitter threshold, latency with a latency threshold and a number of dropped packets with a dropped packet threshold.
- the first endpoint device may additionally have a mapping between communication degradation type and congestion limiting activity.
- the congestion limiting activity may be made according to the mapping. This may involve selecting and performing at least one congestion limiting activity according to the mapping.
- the mapping may additionally be a mapping of a combination of congestion limiting activities to a communication degradation type.
- Each activity combination may include at least one activity and at least one of the activity combinations may comprise increasing application cycle time.
- the different activity combinations may also differ from each other.
- the method may additionally comprise reporting the communication degradation to an activity mapping device.
- the method may additionally comprise receiving a changed mapping from the activity mapping device.
- the first endpoint device may therefore also be operative to report the communication degradation to an activity mapping device as well as operative to receive a changed mapping from the activity mapping device.
- the arrangement may additionally comprise the second endpoint device.
- the second endpoint device may have the same realization and the same type of operation as the first endpoint device.
- the second endpoint device may thereby have a processor acting on computer instructions, whereby the second endpoint device is operative to detect a communication degradation of a data stream and perform a congestion limiting activity from a group of congestion limiting activities.
- the second endpoint device uses the same group of congestion limiting activities. If there is a mapping, it may also be the same mapping in the second endpoint device as in the first endpoint device.
- the second endpoint device may therefore have a receive buffer that is investigated and a transmit buffer in relation to which at least some of the activities are performed.
- the method may therefore also comprise performing, by the second end point device, detecting a communication degradation of a data stream and performing a congestion limiting activity from a group of congestion limiting activities.
- the activity mapping device is a part of the arrangement.
- the activity mapping device may be realized as a processor acting on computer instructions, whereby the activity mapping device is operative to receive communication degradation reports about communication degradation from endpoint devices of communication paths for data streams, which reports include a report from the first endpoint device and possibly also from the second endpoint device, investigate, for the data stream between the first and the second endpoint device, the result of at least one currently mapped activity on a reported communication degradation and change the mapping for this data stream based on the investigation.
- the method comprises, in the activity mapping device, receiving communication degradation reports about communication degradation from endpoint devices of communication paths for data streams, investigating, for the data stream between the first and the second endpoint device, the result of at least one currently mapped activity on a reported communication degradation and changing the mapping for this data stream based on the investigation.
- the invention has a number of advantages.
- the network congestion as experienced by the application is reduced.
- the congestion is thus handled on an application level.
- the availability of the specific application of the data stream is also improved. This may be important because different applications may have different degrees of sensitivity to different types of communication degradation.
- the specific situation of the application is considered in performing the congestion limiting activity..
- the congestion handling arrangement may comprise a first endpoint device as well as possibly a second endpoint device and/or an activity mapping device.
- Fig. 1 schematically shows a first type of industrial automation system IAS 10A, in which a time sensitive network (TSN) may be used for communicating between nodes of the system.
- the industrial automation system 10A may be a process control system, which process control system may be provided in an industrial plant.
- the process control system 10A implements computerized process control for controlling an industrial process P 28.
- industrial processes that may be controlled are electrical power generation, transmission and distribution processes, water purification and distribution processes, oil and gas production and distribution processes, petrochemical, chemical, pharmaceutical and food processes, and pulp and paper production processes. These are just some examples of processes where the system can be applied. There exist countless other industrial processes.
- the processes may also be other types of industrial processes such as the manufacturing of goods.
- a process may be monitored through one or more process monitoring computers, which communicate with a computer or server handling monitoring and control of the process.
- the process control system 10A therefore includes a number of user terminals UT1 12, UT2 14 and UT3 16.
- the user terminals may be process monitoring computers. These computers may here also be considered to form operator terminals and/or engineering terminals and are connected to a first data bus B1.
- a field device is typically an interface via which measurements of the process are being made and to which control commands are given. The measurements may be measurements of physical properties related to the process P 28.
- a field device may as an example be a tank and another as an example a centrifuge.
- the process control server 18 may be involved in controlling the process P 28 based on inputs from field devices, such as from sensors of field devices, and actuating the same or other field devices, such as valves, based on the inputs.
- the field devices and computers are all examples of process control devices that are also real-world objects involved in the control of the process P.
- the field devices 20, 22, 24 and 26 and the process control server 18 are examples of devices that can form nodes of a TSN network. Routers and switches between these devices may also form nodes of the TSN network.
- Fig. 2 shows another type of industrial automation system IAS 10B.
- IAS 10B there are a number of mobile industrial robots.
- a first industrial robot R1 34 communicating wirelessly with a first wireless access point AP1 32 and a second industrial robot R2 38 communicating wirelessly with a second access point AP2 36.
- the two access points 32 and 36 as well as a programmable logic controller PLC 30 are furthermore connected to a third bus B3 for allowing communication between each other.
- the second type of industrial automation system 10B may with advantage employ TSN.
- the PLC 30, the access points 32 and 36 and the industrial robots 34 and 38 are examples of devices that can form nodes of a TSN network.
- Fig. 3 shows an example of a number of nodes in a TSN network 40, where some nodes are end points of TSN streams. Thereby these nodes are endpoint devices forming end points of TSN streams. There is here a first endpoint device EP1 42, a second endpoint device EP2 44, a third endpoint device EP3 46 and a fourth endpoint device EP4 48.
- the TSN network also comprises as first bridge node BN1 50, a second bridge node BN2 52, a third bridge node BN3 54, a fourth bridge node BN4 56 and a fifth bridge node BN5 58, where the bridge nodes are employed for interconnecting the various endpoint devices.
- the first bridge node 50 is connected to the first endpoint device 42 as well as to the second bridge node 52, while the second bridge node 52 is connected to the fifth bridge node 58 as well as to the third bridge node 54.
- the third bridge node 54 is in turn connected to the fourth bridge node 56 as well as to the fifth bridge node 58.
- the second endpoint device 44 is connected to the fourth bridge node 56, while the fourth and the fifth endpoint device 46 and 48 are connected to the fifth bridge node 58.
- the TSN network 40 may be a mixed wireless and wired network.
- the first and the fourth bridge nodes 50 and 56 may as an example be realised as wireless access points, such as wireless routers, while the second, third and fifth bridge nodes 52, 54 and 58 may be realized as wired bridge nodes, such as wired routers or switches.
- the network configuration shown in fig. 3 is merely an example. It is possible with more as well as fewer nodes. It is likewise possible that the network is only wireless or only wired.
- the endpoint devices may be either stationary or mobile.
- the process control server 18 and field devices 20, 22, 24, and 26 of fig. 1 and the PLC 30 and the industrial robots 34 and 38 of fig. 2 are examples of endpoint devices, while the access points 32 and 36 of fig. 2 are examples of bridge nodes.
- all the nodes may be equipped with buffers for transmission and reception of data.
- the first endpoint device 42 is a first endpoint of a first communication path P1 of a first data stream, here also denoted a first TSN stream
- the second endpoint device 44 is a second end point in the first communication path P1 of the first TSN stream.
- the first, second third and fourth bridge nodes 50, 52, 54 and 56 are all connected in the first communication path P1 between the first and the second endpoint devices 42 and 44.
- the third and the fourth endpoint devices 46 and 48 are in turn end points of other TSN streams.
- the first TSN stream is a data stream for an application in the automation system and this application has an application cycle time at which the first and second endpoint device are to transmit data to each other.
- Fig. 4 schematically shows the endpoint devices communicating with an activity mapping device AMD 60.
- the first endpoint device 42 is shown as sending a first communication degradation report CDR1 to the activity mapping device 60
- the second endpoint device 44 is shown as sending a second communication degradation report CDR2 to the activity mapping device 60
- the third endpoint device 46 is shown as sending a third communication degradation report CDR3 to the activity mapping device 60
- the fourth endpoint device 48 is shown as sending a fourth communication degradation report CDR1 to the activity mapping device 60.
- the activity mapping device 60 is in turn shown as sending a mapping update MU to the first and the second endpoint devices 42 and 44.
- the communication degradation reports CDR1, CDR2, CDR3 and CDR4 and the mapping updates MU will be described in more detail later.
- Fig. 5 shows one realization of the first endpoint device 42. It comprises a processor PR 62 and a data storage 64 with computer program instructions 66 that, when executed by the processor 62, implements a congestion limiting function. There is also an input/output (I/O) interface 68 for communication with bridge nodes and the activity mapping device. As can also be seen the I/O interface 68 comprises a transmit buffer TRB 68A for transmitting data to the TSN network 40 and a receive buffer REB 68B for receiving data from the TSN network 40. The transmit buffer 68A is more particularly provided for transmission of data over the previously mentioned first communication path and the receive buffer 68B is provided for reception of data from the first communication path.
- I/O interface 68 comprises a transmit buffer TRB 68A for transmitting data to the TSN network 40 and a receive buffer REB 68B for receiving data from the TSN network 40.
- the transmit buffer 68A is more particularly provided for transmission of data over the previously mentioned first communication path and the receive buffer 68B is provided
- the I/O interface 68 may additionally comprise a radio circuit and antenna for communicating with the first bridge node 50, in case the first bridge node is a wireless access point (not shown).
- the second endpoint device may also have the above-described realization.
- the second endpoint device may thus have the same realization as the first endpoint device.
- Fig. 6 schematically shows one realization of the activity mapping device 60.
- a processor PR 70 and a data storage 72 with computer program instructions 74 that, when executed by the processor 70, performs an activity mapping function.
- I/O input/output
- fig. 7 shows a number of method steps in a method of improving communication, which method steps are being performed by the first endpoint device forming a first end point in the first communication path P1 of the first TSN stream
- fig. 8 schematically shows a number of application cycles that can be used by the first endpoint device 42.
- endpoint devices are communicating with each other in different communication paths for different TSN streams, where such a communication path is used for communicating in an automation application involving at least two endpoint devices, where as an example the first and second endpoint device 42 and 44 are endpoint devices involved in communication for an automation application.
- the application may be a process control application like a distributed process control system (DCS) application, i.e. an application used to control an industrial process. It may additionally or instead be an application involving the use of an industrial robot.
- Communication of this automation application may have a certain priority according to a service level agreement (SLA). Data being transmitted in a stream may then be transmitted using a certain application cycle time corresponding to the level of priority according to the SLA.
- SLA service level agreement
- An application cycle time is then the time at which the application expects transmission of data in a stream to be repeated.
- the application cycle time may thereby define the periodicity of the transmissions of a stream between the endpoint devices. It may more particularly be the time between consecutive transmitted packets of the stream.
- the application cycle time may additionally need to meet a timing requirement of the application. If the application is a process control application the application cycle time may need to be low enough for allowing control to be performed. It may as an example need to be low enough for the application to react in time on a measured property of the process.
- a first application cycle AC1 for a first TSN stream with high priority where the application cycle time (ACT) may be 8 ms
- a second application cycle AC2 for a second TSN stream with medium priority where the application cycle time may be 64 ms
- the application cycle time may be 64 ms
- the application cycle time may be 256 ms.
- the data in the first communication path P1 of the first TSN stream is initially transmitted with a certain application cycle time, between the first and the second end points, for instance the application cycle time 8 ms of the first application cycle AC1.
- a certain application cycle time between the first and the second end points, for instance the application cycle time 8 ms of the first application cycle AC1.
- the first and second endpoint devices are operational technology (OT) endpoints involved in Time Sensitive Communication (TSC) in the TSN network 40.
- TSC Time Sensitive Communication
- the SLA for the communication path between two such end points may define quality requirements, such as:
- ACA Application Cycle Adaption
- AFA Application Functionality Availability
- NC Network Configuration
- ACA and NC can constantly improve AFA when a TSN network for one reason or another is not able to provide the preferred SLA.
- ACA is extra valuable in TSN networks with mobile "OT endpoints", such as Automated Guided Vehicles (AGV).
- AGV Automated Guided Vehicles
- AGV Automated Guided Vehicles
- Another example is related to mobile robots. Assume that 1000 mobile robots (e.g., AGVs and Ind. Robots) are moving in a large factory. Wireless communication from "a distributed cloud" controls their movements. Depending on the location of robots, one or more APs might be overloaded with TSC and probably experience unacceptable packet drops. If too many robots can only communicate via one or a few APs and considering the limited bandwidth provided by those APs it is possible that there will be congestion in the TSN network 40.
- mobile robots e.g., AGVs and Ind. Robots
- Wireless communication from "a distributed cloud” controls their movements.
- one or more APs might be overloaded with TSC and probably experience unacceptable packet drops. If too many robots can only communicate via one or a few APs and considering the limited bandwidth provided by those APs it is possible that there will be congestion in the TSN network 40.
- ACA can be a response to the network situation in both examples, through maintaining full functionality by increasing Application Cycle Time (ACT).
- ACT Application Cycle Time
- the congestion limiting function of the first endpoint device 42 monitors the quality of communication in the TSN network 40. It may more particularly monitor the quality of communication of the first TSN stream. It may do so through monitoring the receive buffer 68B on which it receives packets from the second end point device 44. It may more particularly detect a communication degradation in the first TSN stream through this monitoring or investigating of the receive buffer 68B, S100, which communication degradation is indicative of congestion in the data communication network.
- the communication degradation may be detected through identifying if there is jitter, latency and/or if packets are dropped, where jitter may be a first type of communication degradation, latency may be a second type of communication degradation and dropped packets may be a third type of communication degradation.
- Jitter may be determined through investigating if the periodicity of the packets deviate from a nominal periodicity, latency may be determined based on a comparison of time stamps of received packets with the time of reception and dropped packets may be determined through the absence in the buffer of one or more packets in a sequence of packets. The absent packets should then be preceded by an earlier received packet in the sequence and succeeded by a later received packet in the sequence. It is possible that the packets of a sequence comprise a sequence number, which is incremented by one in each consecutive packet. The absence of packets may be detected through monitoring the above-mentioned sequence numbers possibly also together with time stamps.
- the jitter may be compared with a jitter threshold, the latency with a latency threshold and the number of dropped packets with a dropped packet threshold. If now any of these thresholds is crossed then the corresponding communication degradation type is detected and needs to be addressed.
- the congestion limiting function of the first endpoint device 42 then investigates the types of communication degradation, S110, which investigation involves determining which type of communication degradation that has been detected.
- the first endpoint device 42 has a group of congestion limiting activities that it may perform in order to limit the congestion caused by the communication degradation, where one of the activities is to adapt the application cycle time.
- the group may be in the form of a list of different types of activities, which list may comprise:
- the application cycle adaptation may involve increasing the application cycle time. If for instance the TSN stream transmitted over the first path P1 was transmitted using the application cycle time 8 ms of the first application cycle AC1, the application cycle time may be increased, for instance to that of the second application cycle AC2, e.g. to a time of 64 ms, or even to the application cycle time of 256 ms of the third application cycle AC3. It may here be necessary to at the same time meet the previous-described timing requirements of the application.
- the changing of offset may be carried out in the following way.
- the first end point device 42 may have an initial offset to this clock and this offset may be adjusted by the congestion limiting function of the first endpoint device 42. Thereby the timing of the transmission in a network cycle defined by the clock may be adjusted. This would avoid congestion in the TSN network with other traffic in the same network cycle, but with another offset.
- TDM Time Division Multiplex
- An indicating of a packet that may be dropped may be implemented in the following way.
- the packets may each have a bit, a Drop Eligible Indicator (DEI) bit, that can be set.
- DEI Drop Eligible Indicator
- the congestion limiting function of the first endpoint device 42 may set this bit in some of the packets destined for the second endpoint device 44 and then the network can drop these packets in case communication degradation is experienced.
- the increase of priority will in turn make sure that the packets of the TSN stream are being transmitted at the expense of lower priority communication.
- the choosing of another path may involve the congestion limiting function of the first endpoint device 42 sending a request to a network managing entity for another communication path being set up through the TSN network to the second endpoint device 44.
- Throttle transmission from the transmit buffer may be realized using a so-called Credit Based Shaper (CBS) being set not to exceed a certain Committed Information Rate (CIR). Thereby fewer "micro bursts" may be generated, which microbursts may stress the buffer consumption and increase Store & Forward times in the bridge nodes.
- CBS Credit Based Shaper
- CIR Committed Information Rate
- mapping of the various activity types to the types of communication degradation that can be performed for the first TSN stream.
- This mapping may originally be made by an engineer using an engineering tool via an engineering terminal. As can be seen later, the mapping may later be updated by the activity mapping device 60.
- each such activity combination may include at least one activity and at least one of the activity combinations may comprise ACA.
- the different activity combinations may additionally differ from each other. There may therefore be a first activity combination mapped to the first type of communication degradation, a second activity combination mapped to the second type of communication degradation and a third activity combination mapped to the third type of communication degradation.
- the congestion limiting function of the first endpoint device 42 then performs a congestion limiting activity from the group of congestion limiting activities. In this case it more particularly performs at least one congestion limiting activity according to the mapping, S120. This may involve selecting and performing at least one congestion limiting activity according to the mapping.
- the congestion limiting function of the first endpoint device 42 performs a corresponding activity combination.
- the first type of communication degradation here exemplified by jitter
- the second type of communication degradation here exemplified by latency
- the third type of communication degradation here exemplified by dropped packets
- the increasing of the application cycle time is first made for a low priority data stream. It is furthermore possible that the increasing of the application cycle time is made in an order of priority starting from the data stream with the lowest priority. It is additionally possible that the increasing of the application cycle according to the order of priority is stopped if the communication degradation ceases.
- the congestion limiting function of the first endpoint device 42 will then prioritize increasing ACT (see Figure 8 ) for the low priority third TSN stream with AC3, before the medium priority second TSN stream with AC2 and as a last resort increase the application cycle AC1 of the high priority first TSN stream with AC1 in order to eliminate the cause of recurring loss of packets.
- the first endpoint device 42 may also report the communication degradation to the activity mapping device 60 in the first communication degradation report CDR1, S130.
- the report may in this case also include information of the used activity combination. However, it is also possible that the activity mapping device already knows of the activity combination, in which case it can be omitted from the report.
- the report may also include data about the status of the receive buffer with regard to type of communication degradation before and after the performing of the congestion limiting activity.
- the network congestion as experienced by the application is reduced.
- the congestion is thus handled on an application level.
- the availability of a specific application is also increased. This may be important because different applications may have different degrees of sensitivity to different types of communication degradation.
- the specific situation of the application is considered in performing the congestion limiting activity. This may be beneficial in that other less sensitive traffic through the TSN network may remain uninfluenced.
- the activities being performed in the endpoint device based on a mapping the activity may at the same time be performed fast.
- first and second endpoint devices 42 and 44 may operate in identical ways, which means that they would experience the same types of communication degradation.
- the second endpoint device may thus have the same type of operation as the first endpoint device.
- the two endpoint devices would also perform the same combination of congestion limiting activities.
- the second endpoint device would have a congestion limiting function that detects a communication degradation of the first TSN stream and performs a congestion limiting activity from a group of congestion limiting activities, which congestion limiting activities are the same as in the first endpoint device.
- congestion limiting activity When there is a mapping, it may also be the same mapping in the second endpoint device as in the first endpoint device.
- the second endpoint device may thus also have a receive buffer that is investigated and a transmit buffer in relation to which at least some of the activities are performed.
- ACA and "DEI tagged packet" dropping can often be acceptable mitigation activities to achieve acceptable OT behavior. They give resilience to the whole automation system (huge number of "OT endpoints" communicating over a shared and converged IT/OT network) that depends on reliable TSC. However, as can be seen above, also other activities may be used.
- fig. 9 shows a number of method steps being performed by the activity mapping function of the activity mapping device 60 in order to change the way in which endpoint devices operate for improving communication.
- the activity mapping device 60 is a central function, it may with advantage be provided together with the previously mentioned network managing entity.
- the first endpoint device 42 sends a first communication degradation report CDR1 to the activity mapping device 60 when it detects a communication degradation that needs to be handled for the application associated with the first TSN stream.
- the second endpoint device 44 sends a second communication degradation report CDR2
- the third endpoint device 46 sends a third communication degradation report CDR3
- the fourth endpoint device 48 sends a fourth communication degradation report CDR4.
- the activity mapping device 60 receives communication degradation reports CDR1, CDR2, CDR3 and CDR4 about communication degradation from the different endpoint devices 42, 44, 46 and 48 of communication paths for data streams, S140, which reports include information about the different types of communication degradation being experienced by the endpoint devices and possibly also about the severity of these communication degradations. They may also include data about the status of the receive buffer with regard to type of communication degradation before and after the performing of the congestion limiting activity.
- the reports include a report CDR1 from the first endpoint device 42 and a report CDR2 from the second endpoint device 44. It is additionally possible that the activity combinations used to address the experienced types of communication degradation are included in the reports. As an alternative the activity mapping device 60 may already have this activity combination information.
- the activity mapping function of the activity mapping device 60 may then investigate the results of activities corresponding to the types of communication degradation in the reports, S150. Thereby it investigates the results of currently mapped activities on reported communication degradations.
- the activity mapping function of the activity mapping device 60 may for instance perform this through investigating the status of buffers in the various TSN paths before and after the performing of the activity, such as what is the status of jitter, latency and dropped packets before and after the performing of the activities.
- the investigation may additionally be an investigation made for each data stream. The above-mentioned investigation may thus also be made for the data stream between the first and the second endpoint devices.
- the activity mapping function of the activity mapping device 60 changes the mapping between the types of communication degradation and the congestion limiting activities, S180, which may involve exchanging one activity for another.
- the mapping change may additionally be performed for different TSN streams over different communication paths. It is thereby possible that the first and the second endpoint devices 42 and 44 receive a mapping update MU, while the third and fourth endpoint devices 46 and 48 do not, for instance because for these the result of the above-mentioned investigating may be satisfactory.
- these mapping updates may additionally differ from the mapping update MU made for the first and second endpoint device 42 and 44.
- mapping update MU is only made for the first and the second endpoint device 42 and 44. Therefore, after the mapping update MU has been made, it is then sent to the first and the second endpoint devices 42 and 44, S190. Thereby the first and also the second endpoint device 42 and 44 receive a changed mapping that is defined in the mapping update MU from the activity mapping device 60.
- mapping of the endpoint devices in the investigated communication paths of the TSN streams may be changed over time.
- the combination of the congestion limiting function and the activity mapping function go directly towards endpoint devices and reconfigure their behavior. Also, the associated engineering tool may need to be informed of the mapping updates since initially, by engineering tools, configured "OT endpoint(s)" functionality and network forwarding may emanate from these Engineering Tools. Some mutual exclusion may additionally be required to either let CUC/CNC modify endpoint/network behavior or have the congestion limiting function and the activity mapping function do it.
- traffic flows may be added in the TSN network. This may be done through employing Traffic Injectors for adding TSN streams.
- the traffic flows may be added in order to:
- Traffic Injectors is like stimuli for the congestion limiting function and the activity mapping function. Traffic Injectors helps to improve the capability to mitigate network congestion or too slow forwarding before it happens.
- Traffic Injectors may train this Artificial Intelligence to continuously become more capable to mitigate OT network issues such as congestion.
- a traffic injector may with advantage be implemented as a part of the congestion limiting function.
- the congestion limiting function of the first endpoint device 42 may, as can be seen in fig. 5 , be provided in the form of a processor PR 62 together with a storage medium in the form of a computer program memory 64 including computer program code 66 for performing this function.
- This computer program code may also be provided on a storage medium or data carrier which performs the congestion limiting function when the program code is being loaded into a computer forming the first endpoint device 42.
- One such storage medium 78 with computer program code 66, in the form of a CD ROM disc, is schematically shown in fig. 10 .
- Such computer program may as an alternative be provided on a server and downloaded therefrom into the first end point device.
- the activity mapping function of the activity mapping device 60 may, as can be seen in fig. 6 , be provided in the form of a processor PR 72 together with a storage medium in the form of a computer program memory 72 including computer program code 74 for performing this function.
- This computer program code may also be provided on a storage medium or data carrier which performs the activity mapping function when the program code is being loaded into a computer forming the activity mapping device 60.
- One such storage medium 80 with computer program code 74, in the form of a CD ROM disc, is schematically shown in fig. 11 .
- Such computer program may as an alternative be provided on a server and downloaded therefrom into the activity mapping device.
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Environmental & Geological Engineering (AREA)
- Quality & Reliability (AREA)
- General Engineering & Computer Science (AREA)
- Manufacturing & Machinery (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
- Communication Control (AREA)
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP21207761.4A EP4181478A1 (de) | 2021-11-11 | 2021-11-11 | Verbesserung der kommunikation in einem industriellen automatisierungssystem |
CN202211370951.9A CN116112439A (zh) | 2021-11-11 | 2022-11-03 | 改进工业自动化系统中的通信 |
US18/052,837 US12113693B2 (en) | 2021-11-11 | 2022-11-04 | Communication in an industrial automation system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP21207761.4A EP4181478A1 (de) | 2021-11-11 | 2021-11-11 | Verbesserung der kommunikation in einem industriellen automatisierungssystem |
Publications (1)
Publication Number | Publication Date |
---|---|
EP4181478A1 true EP4181478A1 (de) | 2023-05-17 |
Family
ID=78598939
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP21207761.4A Pending EP4181478A1 (de) | 2021-11-11 | 2021-11-11 | Verbesserung der kommunikation in einem industriellen automatisierungssystem |
Country Status (3)
Country | Link |
---|---|
US (1) | US12113693B2 (de) |
EP (1) | EP4181478A1 (de) |
CN (1) | CN116112439A (de) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN119292990B (zh) * | 2024-11-22 | 2025-04-01 | 上海壁仞科技股份有限公司 | 计算设备、数据处理方法以及计算系统 |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2019125396A1 (en) * | 2017-12-18 | 2019-06-27 | Intel Corporation | Enhanced time sensitive networking for wireless communications |
US20200259896A1 (en) | 2019-02-13 | 2020-08-13 | Telefonaktiebolaget Lm Ericsson (Publ) | Industrial Automation with 5G and Beyond |
US20200412813A1 (en) * | 2016-03-21 | 2020-12-31 | Transportation Ip Holdings, Llc | Vehicle control system |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3526937A1 (de) * | 2016-10-14 | 2019-08-21 | Telefonaktiebolaget LM Ericsson (publ.) | Heterogene flussüberlastungsregelung |
CN109800092A (zh) | 2018-12-17 | 2019-05-24 | 华为技术有限公司 | 一种共享数据的处理方法、装置及服务器 |
US11265834B2 (en) * | 2019-10-10 | 2022-03-01 | Acer Incorporated | Base stations and methods for time-sensitive networking (TSN) clock information delivery |
US11115308B2 (en) * | 2020-01-07 | 2021-09-07 | Alibaba Group Holding Limited | System and method for congestion control using time difference congestion notification |
WO2022103513A1 (en) * | 2020-11-12 | 2022-05-19 | Arris Enterprises Llc | Electronic apparatus and method for latency measurements and presentation for an optimized subscriber service |
-
2021
- 2021-11-11 EP EP21207761.4A patent/EP4181478A1/de active Pending
-
2022
- 2022-11-03 CN CN202211370951.9A patent/CN116112439A/zh active Pending
- 2022-11-04 US US18/052,837 patent/US12113693B2/en active Active
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20200412813A1 (en) * | 2016-03-21 | 2020-12-31 | Transportation Ip Holdings, Llc | Vehicle control system |
WO2019125396A1 (en) * | 2017-12-18 | 2019-06-27 | Intel Corporation | Enhanced time sensitive networking for wireless communications |
US20200259896A1 (en) | 2019-02-13 | 2020-08-13 | Telefonaktiebolaget Lm Ericsson (Publ) | Industrial Automation with 5G and Beyond |
Non-Patent Citations (2)
Title |
---|
AHMED NASRALLAH ET AL: "Reconfiguration Algorithms for High Precision Communications in Time Sensitive Networks: Time-Aware Shaper Configuration with IEEE 802.1Qcc (Extended Version)", ARXIV.ORG, CORNELL UNIVERSITY LIBRARY, 201 OLIN LIBRARY CORNELL UNIVERSITY ITHACA, NY 14853, 27 June 2019 (2019-06-27), XP081384950 * |
BELLIARDI RUDY <RUDY BELLIARDI@SCHNEIDER-ELECTRIC COM> DORR JOSEF <JOSEF DORR@SIEMENS COM> ENZINGER THOMAS <THOMAS ENZINGER@BR-AUT: "Use Cases IEC/IEEE 60802 V1.3", vol. 802.1, no. v01, 12 November 2018 (2018-11-12), pages 1 - 74, XP068135556, Retrieved from the Internet <URL:www.ieee802.org/1/files/public/docs2018/60802-stanica-comments-use-cases-1118-v01.pdf> [retrieved on 20181112] * |
Also Published As
Publication number | Publication date |
---|---|
US12113693B2 (en) | 2024-10-08 |
CN116112439A (zh) | 2023-05-12 |
US20230144148A1 (en) | 2023-05-11 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN108696387B (zh) | 用于过程控制系统中的无线网状网络的预测性连通性诊断 | |
CN110177054B (zh) | 一种端口队列调度方法、装置、网络控制器及存储介质 | |
JP2018191283A (ja) | プロセス制御システムにおける無線メッシュネットワーク間での転送のための複数の無線ノードのインテリジェントな順序策定 | |
EP2683199B1 (de) | Bestimmung der Kommunikationswege in einem drahtlosen Kommunikationsnetzwerk | |
CN110235418B (zh) | 通信系统、通信装置以及通信方法 | |
CN113261220B (zh) | 用于处理tsn通信链路的故障的方法和控制节点 | |
Behnke et al. | Real-time performance of industrial IoT communication technologies: A review | |
EP2904761A1 (de) | Paketpriorisierung in einem industriellen drahtlosen netzwerk | |
EP3895398B1 (de) | Kommunikationssystem mit de-jitter-puffer zur jitter-reduzierung | |
US10616083B2 (en) | Data acquisition using remote platform gateways | |
EP4181478A1 (de) | Verbesserung der kommunikation in einem industriellen automatisierungssystem | |
CN101311863A (zh) | 用于控制自动化过程的系统 | |
US12261922B2 (en) | Method and gateway device for transmitting datagrams via a plurality of networks | |
US20160006648A1 (en) | Distributed Control System and Control Method Thereof | |
US20130235857A1 (en) | Meeting A Communication Restriction Requirement In A Process | |
RU2669077C2 (ru) | Способ ограничения использования каналов | |
CN110300055B (zh) | 异构现场总线用网关系统 | |
CN111656737B (zh) | 用于工业自动化系统的无线电通信系统和用于运行无线电通信系统的方法 | |
US20230006939A1 (en) | Establishing Time-Sensitive Communications Between Industrial End Devices and an Ethernet Network | |
US20240090011A1 (en) | Time sensitive network (tsn) quality of service (qos) management | |
JP4940796B2 (ja) | 通信制御システム | |
US20250126075A1 (en) | Communication Controller and Method for Transmitting Time-Critical Data within a Communication System | |
Robinson et al. | Toward the Design of a Transport Layer for Networked Control Systems |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20231117 |
|
RBV | Designated contracting states (corrected) |
Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |