[go: up one dir, main page]

WO2007066166A1 - Procede et systeme pour le traitement et l'affichage d'instructions de commande - Google Patents

Procede et systeme pour le traitement et l'affichage d'instructions de commande Download PDF

Info

Publication number
WO2007066166A1
WO2007066166A1 PCT/IB2005/003709 IB2005003709W WO2007066166A1 WO 2007066166 A1 WO2007066166 A1 WO 2007066166A1 IB 2005003709 W IB2005003709 W IB 2005003709W WO 2007066166 A1 WO2007066166 A1 WO 2007066166A1
Authority
WO
WIPO (PCT)
Prior art keywords
equipment
image
control
view
user
Prior art date
Application number
PCT/IB2005/003709
Other languages
English (en)
Inventor
Charlotte Skourup
John Pretlove
Thomas Pettersen
Christoffer Apneseth
Pierre ÖBERG
Original Assignee
Abb Research Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Abb Research Ltd filed Critical Abb Research Ltd
Priority to PCT/IB2005/003709 priority Critical patent/WO2007066166A1/fr
Publication of WO2007066166A1 publication Critical patent/WO2007066166A1/fr

Links

Classifications

    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00—Programme-control systems
    • G05B19/02—Programme-control systems electric
    • G05B19/18—Numerical control [NC], i.e. automatically operating machines, in particular machine tools, e.g. in a manufacturing environment, so as to execute positioning, movement or co-ordinated operations by means of programme data in numerical form
    • G05B19/409—Numerical control [NC], i.e. automatically operating machines, in particular machine tools, e.g. in a manufacturing environment, so as to execute positioning, movement or co-ordinated operations by means of programme data in numerical form characterised by using manual data input [MDI] or by using control panel, e.g. controlling functions with the panel; characterised by control panel details or by setting parameters
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00—Programme-control systems
    • G05B19/02—Programme-control systems electric
    • G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
    • G05B19/4183—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM] characterised by data acquisition, e.g. workpiece identification
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/32—Operator till task planning
    • G05B2219/32014—Augmented reality assists operator in maintenance, repair, programming, assembly, use of head mounted display with 2-D 3-D display and voice feedback, voice and gesture command
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/35—Nc in input of data, input till input file format
    • G05B2219/35482—Eyephone, head-mounted 2-D or 3-D display, also voice and other control
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/35—Nc in input of data, input till input file format
    • G05B2219/35495—Messages to operator in multimedia, voice and image and text
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P80/00—Climate change mitigation technologies for sector-wide applications
    • Y02P80/10—Efficient use of energy, e.g. using compressed air or pressurized fluid as energy carrier
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Definitions

  • This invention relates to an improved method and system for providing, processing and displaying maintenance and/or control instructions for an equipment, plant or a process by means of accessing data and stored information and displaying information relevant to the device or process.
  • the invention provides improved means to generate and display instructions necessary to configure, maintain or repair equipment.
  • a traditional " automation system is one in which each physical asset is described in a database. In its turn, this database is
  • An installation may also include equipment from different suppliers and from different industries. It is a complex and difficult task to retrieve information from all of those systems so as to give a reliable and extensive picture even on a historical basis. It is also very difficult, time consuming and error prone to organize, enter, maintain and retrieve information related to a specific device. It is even more difficult to retrieve and or access such information when an alarm or other event is reported.
  • the real world object may be a single device, an object in a process or complete equipment.
  • augmented reality image may be overlaid on a real world image.
  • world/augmented reality data may be carried out to provide an interaction with a control device or system.
  • one or more embodiments of the invention provide an improved method for processing and displaying control or maintenance instructions for an apparatus, device or equipment in an industrial process or facility comprising one or more control systems for
  • device or process-related information and other data for each said equipment, plant or process are stored in and may be retrieved by said control system, the method comprising identifying a said equipment, making and processing an image of a first view of the said equipment, making, retrieving or recording an annotation of control or maintenance instructions for said equipment and arranging the annotation represented as a graphic element for a display, and by combining the first view of the image and the annotation into a composite image, and displaying the composite image of said equipment combined with additional control or maintenance instructions to a user.
  • an improved method for processing and displaying control or maintenance instructions for an apparatus, device or equipment in an industrial process or facility comprising one or more control systems for monitoring and control, wherein device or process-related information and other data for each said equipment, plant or process are stored in and may be retrieved by said control system, the method comprising recording an annotation and wherein the annotation for said equipment is placed in a selected position relative to the first view of the image .
  • an improved method for processing and displaying control or maintenance instructions for an apparatus, device or equipment in an industrial process or facility comprising one or more control systems for monitoring and control, wherein device or process-related information and other data for each said equipment, plant or process are stored in and may be retrieved by said control system, the method comprising generating the annotation as a part of a layer for superposition on the first view of the image.
  • an improved method for processing and displaying control or maintenance instructions for an apparatus, device or equipment in an industrial process or facility comprising one or more control systems for monitoring and control, wherein device or process-related information and other data for each said equipment, plant or process are stored in and may be retrieved by said control system, the method comprising arranging the annotation displayed relative a position on first view of the image or relative a position on the display screen.
  • an improved method for processing and displaying control or maintenance instructions for an apparatus, the method comprising displaying an instance of the composite image
  • an improved method for processing and displaying control or maintenance instructions for an apparatus, the method comprising recording an annotation which provided by an input action of a second user or expert such as manipulating a second instance of the composite image displayed on the second display.
  • an improved method is provided for processing and displaying control or maintenance instructions for an apparatus, the method comprising adding one or more annotations are added to the composite image and displaying the image to a plurality of other users .
  • an improved method for processing and displaying control or maintenance instructions for an apparatus, the method comprising in part providing control or maintenance instructions used to configure a set point or switch a device on or off by means of software means of part of the composite image.
  • an improved method for processing and displaying control or maintenance instructions for an apparatus, the method comprising in part activating a software means and thereby providing control or maintenance instructions used to generate one or more control signals.
  • an improved method for processing and displaying control or maintenance instructions for an apparatus, the method comprising identifying said equipment by image processing a unique marker means on or near said equipment .
  • an improved method for processing and displaying control or maintenance instructions for an apparatus, the method comprising identifying said equipment by image processing images provided by the optical means or by processing the images in part by scanning natural features of the images.
  • an improved method is provided for processing and displaying control or maintenance instructions for an apparatus, the method comprising changing the position and/or orientation of the annotation in the composite image relative a distance or size relationship in a second view of the image dependent on a distance or size relationship determined with an image of a first view.
  • an improved method for processing and displaying control or maintenance instructions for an apparatus, the method comprising changing both the position and size of the annotation relative to, and depending on, a second view of the image dependent on the size relationship determined with the first view.
  • an improved method for processing and displaying control or maintenance instructions for an apparatus, the method comprising identifying said equipment by processing
  • an improved method for processing and displaying control or maintenance instructions for an apparatus, the method comprising generating instructions and information for carrying out a repair, re-configure, re-programming or replacement of a faulty part of said equipment, plant or process.
  • one or more embodiments of the invention provide an improved system for processing and displaying control or maintenance instructions for an apparatus, device or equipment in an industrial process or facility comprising one or more control systems for
  • control system comprising an AR system comprising a tracking means, a display means, at least one computer means, a data communication means for communicating an image of a first view of said equipment, and computer software image processing means for identifying the said equipment in the industrial process or facility, and computer software means to record control or maintenance instructions comprising any of text, video or voice messages and computer software for attaching said message information, and computer software means to provide a composite image of an image of said equipment combined with additional control or maintenance instructions to a user.
  • AR system comprising a tracking means, a display means, at least one computer means, a data communication means for communicating an image of a first view of said equipment, and computer software image processing means for identifying the said equipment in the industrial process or facility, and computer software means to record control or maintenance instructions comprising any of text, video or voice messages and computer software for attaching said message information, and computer software means to provide a composite image of an image of said equipment combined with additional control or maintenance instructions to a user.
  • the invention comprises an improved system for processing and displaying an augmented reality representation of computer- generated graphical information, generated and stored in advance, overlaid the real world.
  • Such an improved system may also comprise a communication system supporting voice
  • such an improved augmented reality system may comprise: a handheld interacting and pointing device with a tracking system for determining its position and orientation in relation to a world coordinate system and a portable display device eg preferably a wearable device such as glasses, head- mounted display or head-up display or else a PDA, notebook, tablet computer, or similar, for visualizing augmented reality overlaid the view of the real world.
  • the display device further comprises: a camera, such as a video camera of some sort for capturing a stream of images of the environment mounted on or integrated with the display device.
  • the camera is mounted in a fixed position at the display device, and the display device is preferably located along the camera view axis and at the camera's image plane.
  • the system combines computer-generated graphics and annotations with the live video stream and projects the combined augmented reality video onto the display device.
  • the user sees the video with overlaid virtual information as if he was looking at the real world.
  • the computer-generated graphics are registered directly onto the display device and follow, on the image viewed, and on the user's view of the real world.
  • the virtual graphics are overlaid on the optical image of the real world without including a video the real world.
  • One or a series of still images may be used to carry out the same or similar steps or actions with the stream of video images described above .
  • unique identity markers may be placed at objects (equipment, devices and systems) in the environment. These are preferably processed by a recognition system for recognizing the unique IDs and use those IDs to identify a known device or equipment controlled by a control system. Further a tracking system is included for determining position and orientation of a tracking device in relation to a world coordinate system. As well, or as an
  • a recognition system for recognizing and tracking one or more visible objects at a physical location may be used.
  • a vision-based tracking system using a recognition or tracking technique known as Natural Feature tracking may be used.
  • Natural Feature tracking For more detail about a type of natural feature tracking see for example an article entitled: Natural Feature Tracking for Extendible Robust Augmented Realities, Park, You & Neuman, UCLA, in a paper for the first International Workshop on
  • Augmented Reality June 1998.
  • This type of technique may be used with image processing to recognise one or more objects in the real world and supply information about viewer-to-object distance, and changes in that distance, so that a position of the user in relation to certain real world objects may be determined. The determinations or calculations may then be used provide a graphic display depending in part on how the position of the user and the orientation of the user changes relative to a given real object.
  • the processing of the image may be speeded up by combining a calculation of a movement path of the camera/viewer based on changes in the viewer-to-object distance for one or more objects. Calculations are advantageously carried out by
  • a major advantage of the present invention is that a maintenance action to respond to a new alarm or other event may be handled in a more timely way.
  • Collaboration between and contact with internal users, technicians, operators and/or engineers with known and recorded technical information and/or expertise may be carried out quickly and effectively.
  • the engineer, operator or other user has a portable display device or portable computing and display device. This may comprise devices such as a PDA, as a head-up display arranged as glasses or on an adapted helmet.
  • a camera or other position tracking means is mounted on or near the glasses, so capturing quite closely the user's view of the equipment, including the user's position and orientation, etc.
  • Communication is preferably carried out using a head-set, mobile phone, phone and hands-free type attachment so that the user may communicate with other users, experts, and at the same time have one or more hands free for manipulating the display and or making an adjustment to a control panel or component etc. of the equipment, plant or process.
  • Annotations may be made in real time to information, text or graphics displayed to each user and or expert collaborating over the issue. Annotations or
  • attachments in the form of text annotations, digital files, video clips, sound clips may be attached to a shared electronic document or notice board, shared display screen means, virtual white board etc.
  • the information retrieved and/or developed during collaboration provides instruction to the user for monitoring, troubleshooting, configuring or repairing the equipment .
  • the method and system are facilitated by one or more computer programs in the control system and a computer architecture with which each user may be configured in a database, log-in file, table or similar to record one or more types of technical expertise he/she is known to possess and one or more types of communication means to the expert.
  • a software entity representing a component part of the equipment, plant or process in the control system is selected, a second software entity may be activated to access and retrieve information, especially contact information, phone numbers, IP phone numbers,
  • FIGURE 1 shows a schematic diagram of an overview of a system to generate control and/or maintenance instructions for an
  • FIGURE 2 is a schematic diagram overview of a system to generate control and/or maintenance instructions for an industrial device or process according to another embodiment of the invention.
  • FIGURE 3 is a schematic diagram of a screen display showing a selection on a composite image provided to generate control and/or maintenance instructions for an industrial device or process according to an embodiment of the invention;
  • FIGURE 4 is a schematic diagram of a screen display showing a selection on a composite image provided to generate control and/or maintenance instructions for an industrial device or process according to another embodiment of the invention
  • FIGURE 5 is a flowchart for a method for an improved way to access, annotate and display information for generating control and/or maintenance instructions for an industrial device or process according to an embodiment of the invention
  • FIGURE 6 is a flowchart for a method for an improved way to access, share, collaborate and display shared information for generating control and/or maintenance instructions for an industrial device or process according to another embodiment of the invention.
  • FIGURES 7-9 shows a schematic diagram of a view of another screen display showing how an annotation may be fixed relative a point on a first image, according to an embodiment of the invention.
  • FIGURE 10 shows a schematic diagram of a view of a screen display showing how an annotation may be displayed as fixed relative a point on a display screen.
  • Figure 1 shows an overview for an improved system according to an embodiment of the invention. It shows a user 1, a device or equipment 7 to be monitored, repaired or controlled, and a display 3.
  • the user holds a visible pointer 4 of some sort and a wearable computer 2.
  • the user has a camera 6 of some sort preferably arranged mounted so as to record an image from the position and orientation direction that the user is looking in.
  • the user has the display device arranged in the form of a head- up display 3, glasses or video glasses.
  • a schematic view as seen by user 1 of the composite image 5 provided in display device 3 is shown. Signal, data and image information is
  • the view seen by the user comprises an image, or a composite image, of a first image 7' of the real world equipment and a view 4' of the pointer 4 relative to the image 7' of the real world equipment.
  • any of a text 9a, a diagram 9b or an annotation 9c may be superimposed over the image 7' of the equipment.
  • the composite image 5 displayed to user 1 may
  • Figure 2 shows schematically a user 1, a wearable computer 2, a first display device 3a and a second display device 3b.
  • the equipment object 7, the device or process of interest, is shown arranged with a marker 8 for the purpose of identifying it.
  • the user may have a camera integrated with the first display 3a worn by the user 1 as a monocular viewer, glasses or head-up display.
  • the computing functions may be provided by the wearable computer 2, by the second or alternative display 3b, the glasses or head- up display 3a, and/or may be distributed among these devices.
  • Figure 3 shows schematically another embodiment of the improved system.
  • the figure shows the composite image 5 seen by user 1 comprising a view of the equipment 7 of interest.
  • the view shows an image 4' of the pointer 4 held by the user displayed relative the equipment.
  • Information, retrieved information 9a, 9b and added annotations 9c from one or more other users or experts may each be superimposed on any part of the composite image of the equipment.
  • the annotations may be configured or arranged to be fixed relative a part of the first view of the equipment. In this case, the annotations move and change size or even
  • annotations may otherwise configured or arranged.
  • annotations may be in a fixed position relative a part of the computer display frame or apparatus screen. In this case, the or certain of the annotations stay on screen
  • annotations are always available for the user to see.
  • a virtual control panel or an on-line parameter reading may be continuously displayed even when the user moves his head and looks at other views .
  • processing a unique marker 8 may be retrieved from data storage accessible by the control system, generated, and provided superimposed as an annotation on the image 7' of the equipment.
  • VCP virtual control panel
  • the user sees the virtual control panel (VCP) as if it were attached to the real world equipment 7 because his head position is tracked by AR tracking means such as camera 6 and the image recorded and displayed to the user is adjusted accordingly.
  • the VCP may be arranged always fixed to a selected part of the equipment image, or may be arranged visible on the display while the user orientation and position change.
  • the virtual control panel 30 comprises a plurality of input or control elements, which may include a mode or status indicator 33, part name or number 34, one or more parameters or set-points 35, selection or activity indicators 88 and control means or control buttons 37.
  • the virtual control panel may have a Status or Mode set to On Line, such that real time values for parameters such as % load, case temperature, rotational speed in rpm and supply current in amps etc are displayed.
  • Other Modes may be selected such as for example Modes such as Off Line, On Line or Trend.
  • Mode Trend provides for data retrieval from the control system and presents historical data or calculates predicted data or trends
  • the user 1 may monitor and inspect a condition of an equipment 7 using an embodiment of the improved system.
  • the user selects an equipment, which is identified in the control system by means of a marker 8 or alternative means, for example scanning methods as described below.
  • User 1 may then retrieve information relevant to the identified equipment by means of the control system 12, stored in different formats in one or more databases 14, and examine the information.
  • the user, an online expert or another person may record annotations by voice or text or freehand notes and attach those annotations 9c.
  • FIG. 3 shows schematically attached text information 9a, attached freehand notation 9b, attached diagram or flowchart 9c.
  • the attached information which may have been contributed by other experts or users, called here annotations, may be used by user 1 as instructions or additional to carry out actions such as: carry out an inspection, adjust a set point, control a device or process, switch a device on or off. These actions are carried out by the user 1 by means of switching or operating buttons 37 or selection means 38 on the virtual control panel 30.
  • a user may then inspect a condition of a motor and access or retrieve examine real time values for parameters such as speed, temperature, and load.
  • the user may make control inputs and or actions using a known industrial control or process control system to input set-points, switch a device on or off etc..
  • a method of an embodiment of the invention may comprise that the user 1 receives technical information or additional technical information from a local or internal colleague relevant to a device, apparatus or problem that the person is trained for or responsible for.
  • the method according to an embodiment of the invention comprises the steps of that a maintenance person requiring technical information picks up or preferably puts on a user AR equipment, which comprise be a PDA, wearable computer, headset based device, comprising a display 3, 3a, 3b.
  • a maintenance person requiring technical information picks up or preferably puts on a user AR equipment, which comprise be a PDA, wearable computer, headset based device, comprising a display 3, 3a, 3b.
  • the control system 12 may generate information instructing the logged on maintenance person where in the plant to go and what the problem is (the system may indicate a new alarm via text, a visual or graphic display, or text-to- speech (TTS) .
  • TTS text-to- speech
  • the maintenance person or user can ask for more info via text or voice.
  • the maintenance person goes to a physical location and or a location of a plant or process section (functional location) indicated by the system, observes the problem, alarm or other event.
  • the AR equipment may be used to recognise an equipment of interest 7 by means of: an asset number or similar, a wireless node mechanism, a marker 8 installed for the purpose of identifying the equipment to an AR system, a method of scanning equipment surroundings and processing the image to identify natural features to match to a predetermined location of the equipment, or a combination of equipment identity in the incoming alarm information together with any of the above.
  • an asset number or similar a wireless node mechanism
  • a marker 8 installed for the purpose of identifying the equipment to an AR system
  • a method of scanning equipment surroundings and processing the image to identify natural features to match to a predetermined location of the equipment or a combination of equipment identity in the incoming alarm information together with any of the above.
  • the maintenance person can view service history and
  • the maintenance person If the maintenance person cannot fix the problem on his own, and needs help/support, he activates or mouse-clicks software means in the control system associated with the device or problem of interest.
  • the system finds an appropriate online expert (where navigation options may include using a history of previous similar problems or a maintenance history of the selected device, process) or the user may select a specific person, and contact is then established by computer and/or by phone in a suitable way.
  • the information stored on the specific person or expert includes a unique address, internally with IP addresses and workstation addresses of users internal to the plan, and, preferably for external experts an IP address, URL, phone number etc of a support database, preferably an ABB database, and information about the local system to be used in support requests.
  • the second person agrees to accept the support request and receives access to the alarm or event, and gets an overview of at least the latest event as a starting point.
  • Voice contact may be established automatically, for example via voice-over-IP (VoIP) .
  • Options are provided for application sharing and/or to send pictures or files, and in particular for the selected specific person to share the composite image 5 seen by the user, and to add notes, comments, other information which are attached to the composite image as annotations.
  • VoIP voice-over-IP
  • Options are provided for application sharing and/or to send pictures or files, and in particular for the selected specific person to share the composite image 5 seen by the user, and to add notes, comments, other information which are attached to the composite image as annotations.
  • the second person depending on user log-in information and/or authority or
  • privilege data be enabled to also control the on-screen pointer image 4' by any computer input means suitable for selecting a control element of the VCP displayed by a graphical user
  • Annotations may include the possibility of attaching video, voice or pictures to a support request, and retrieving a "buddy- list" to give an overview of available local experts ( Figure 5) . It may be desirable to add some logic to the list so that local contacts with knowledge about a specific problem are given priority, and so that the logic establishes which users or experts are now available, logged in, on call, suitable but not available, when available and why.
  • An operational difference exists between local experts and remote (eg ABB Support)
  • Figure 5 shows a first flowchart for a method which comprises the following steps: 51 User is notified by control system 12 in some way of an alarm or event
  • User may retrieve and examine a list of internal operators, experts, and/or external experts with any of whom the user may choose to seek information or instructions for controlling an equipment or process .
  • Figure 6 shows a second flowchart for a method which comprises the following steps:
  • Figure 4 shows another embodiment of the improved system.
  • the figure shows another composite image 5 seen by user 1 comprising a view of the equipment 7 of interest.
  • the view shows an image 4' of the pointer 4 held by the user displayed relative the equipment.
  • Information, retrieved information 9a, 9b and added annotations 9c from one or more other users or experts may each be superimposed on the composite image of the equipment.
  • the view of the equipment 7 of interest includes a unique marker 8 positioned in the view and, in this case, positioned on the actual equipment itself.
  • the marker may be identified by using an image processing software to detect presence of a marker and identity of the marker on the equipment of interest.
  • a virtual control panel 30 for the equipment 7 as in the control system identified by marker 8 may be retrieved from data storage, generated, and provided as superimposed on the image 7' of the equipment.
  • the virtual control panel 30 comprises a plurality of control elements, which may include a mode or status indicator 33, part name or number 34, one or more parameters or set-points 35, selection or activity indicators 88 and control means or control buttons 37.
  • the virtual control panel may have a Status or Mode set to Edit, such that set-point values for motor parameters such as: case temperature,
  • the figure also represents an example of such method steps, in that a first 9b annotation was provided giving instructions, in this case for the user to "select Edit" mode, and a dotted
  • Pointer image 4' with solid lines indicates pointer image 4' positioned on a control element and activating the control element.
  • Modes such as Off Line or Trend which retrieves from the control system and presents historical data or predicted data respectively for the equipment .
  • the virtual or augmented information is annotated and linked to the first view 7 of the equipment.
  • the equipment has been described as identified in this case by a unique marker 8 arranged on or near the equipment, which is then matched with stored data about process devices, equipment etc..
  • an annotation 9d is associated with part of of a control panel in a first image 7 of the equipment.
  • the view 17 of the equipment has changed, but the annotation is still fixed to the same part of the equipment image, despite that the view or orientation of the user has changed.
  • the equipment view 27 is
  • Figure 10 illustrates an annotation form
  • Figure 8 arranged fixed relative the screen display, so that as the user changes orientation and position the annotation remains in view in the same place.
  • the annotation 9 in the augmented reality view of the composite image equipment 7', I' 1 may not be associated to a selected part of the equipment or to any part of the displayed image and may instead "float" or remain in view indefinitely even when the user changes position and orientation completely. Thus an annotation may remain on the display even when the user goes to another part of the plant, if the user so desires .
  • the unique marker is identified by means other than by image processing to recognise a sign, symbol, number or other visual marker.
  • Non-visual markers such as IR readable signs, or markers using other means such as acoustic transmissions may be adapted for use.
  • Equipment identity may also be established using one or more purpose-specific wireless transmitters in the vicinity of the equipment of interest, or by using wireless communications based on wireless transmitters forming part of a data network in the vicinity.
  • the equipment is identified for tracking purposes and tracked relative a view of the real world using an optical mapping technique that involves identifying a series of objects or features in two or more repeated images taken by a camera or video camera of the equipment and its surroundings.
  • An image processing software is used to identify objects detected optically, track the same objects over a succession of images, and calculate a position and orientation of the camera or sensor receiving and taking the images. In this way, the position and orientation of the user with a tracking apparatus 6, figures 1, 2 can be calculated.
  • the image processing may be based on recognising and natural features, especially features with relatively higher contrast to their background, and subsequently calculating, based on the change in a distance between those natural features in an image, a position of the viewer relative the equipment or other object. Changes in the position and size of the annotation relative the equipment due to any change in position or orientation of the user's head are calculated in this way and the size and position of the annotation relative the equipment (see Figures 7-9) is displayed accordingly.
  • the image processing may be based in part on a Natural Features method.
  • This type of method concerns identifying points on an object or in a surrounding, points such as edges or corners that show some visual contrast.
  • an image processing program tracks identified points in one or more successive frames. From these identified points and the paths the points move along the position and orientation of the scanner or camera is calculated.
  • This position data is in turn used to determine, based on position or location data stored for the various process devices, equipment in the control system, which equipment in the plant is being looked at or inspected etc on the basis of the position so estimated. By this means the equipment can be identified without the use of a identifying marker when stored position data for devices, equipment at the location are available
  • the selected part of the equipment of interest is identified and tracked in a view of the real world by measuring a distance to one or more wireless node means arranged on or near said equipment.
  • Transmissions from one or more wireless nodes comprised, for example, in a wireless LAN or in an ad-hoc wireless network, in a Bluetooth pico-net or a ZigBee network may be used to calculate a relative physical location based on signal strength of other radio signal
  • the equipment may be mapped to location data stored in a control system of the industrial plant.
  • the methods of the invention may be carried out by means of one or more computer programs comprising computer program code or software portions running on a computer, data server or a processor.
  • the microprocessor (or processors) comprises a central processing unit CPU performing the steps of the method according to one or more facets of the invention, such as the methods shown in Figures 5, 6.
  • the methods are performed with the aid of one or more said computer programs, which are stored at least in part in memory accessible by the one or more processors.
  • a program or part-program that carries out some or all of the steps shown and described in relation to in Figures 5 and 6 may be run by a computer or processor of the control system.
  • At least one of the or each processors may be in a central object oriented control system in a local or distributed computerised control system.
  • said computer programs may also be run on one or more general purpose industrial microprocessors or computers instead of one or more specially adapted computers or processors .
  • the computer program comprises computer program code elements or software code portions that make the computer perform the method using equations, algorithms, data, stored values and
  • a part of the program may be stored in a processor as above, but also in a ROM, RAM, PROM, EPROM, or EEPROM chip or similar memory means.
  • the program in part or in whole may also be stored on, or in, other suitable computer readable medium such as a magnetic disk, CD-ROM or DVD disk, hard disk, magneto-optical memory storage means, in volatile memory, in flash memory, as firmware, stored on a data server or on one or more arrays of data servers .
  • Other known and suitable media, including removable memory media such as removable flash memories, hard drives etc. may also be used.
  • Data may also be communicated wirelessly, at least in part, to portable devices carried or worn by a user.
  • communications may be carried out using any suitable protocol, including a wireless telephone system such as GSM or GPRS.
  • a wireless telephone system such as GSM or GPRS.
  • Short range radio communication is a preferred technology, using a protocol compatible with, standards issued by the Bluetooth Special Interest Group (SIG), any variation of IEEE-802.11, WiFi, WiMax, Ultra Wide Band (UWB), ZigBee or IEEE-802.15.4, IEEE-802.13 or equivalent or similar.
  • Wireless communication may also be carried out using Infra Red (IR) means and protocols such as IrDA, IrCOMM or similar.
  • IR Infra Red
  • Wireless communication may also be carried out using sound or ultrasound transducers, through the air or via work object construction, pure magnetic or electric fields (capacitive or inductive communication) or other types of light, such as for example LED, laser, as communication media with standard or proprietary protocols.
  • the computer programs described above may also be arranged in part as a distributed application capable of running on several different computers or computer systems at more or less the same time. Programs as well as data such as energy related
  • OPC optical coherence control
  • OPC servers OPC servers
  • object request broker such as COM, DCOM, or CORBA
  • web service a web service

Landscapes

  • Engineering & Computer Science (AREA)
  • Manufacturing & Machinery (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • General Engineering & Computer Science (AREA)
  • Quality & Reliability (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

La présente invention concerne un procédé pour le traitement et l'affichage d'instructions de commande et d'information technique pour un équipement, une installation ou un processus dans une installation industrielle. Une entité logicielle peut être configurée avec des identités dudit équipement, de ladite installation ou desdits processus sélectionnés. L'entité logicielle peut également récupérer l'information associée au dit équipement, à ladite installation ou au dit processus grâce à sa configuration. Une information peut être combinée et annotée sur le dispositif d'affichage pour fournir des instructions de commande ou d'entretien. L'invention concerne également un dispositif d'affichage, un programme d'ordinateur et un système de commande,
PCT/IB2005/003709 2005-12-08 2005-12-08 Procede et systeme pour le traitement et l'affichage d'instructions de commande WO2007066166A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/IB2005/003709 WO2007066166A1 (fr) 2005-12-08 2005-12-08 Procede et systeme pour le traitement et l'affichage d'instructions de commande

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/IB2005/003709 WO2007066166A1 (fr) 2005-12-08 2005-12-08 Procede et systeme pour le traitement et l'affichage d'instructions de commande

Publications (1)

Publication Number Publication Date
WO2007066166A1 true WO2007066166A1 (fr) 2007-06-14

Family

ID=36617247

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2005/003709 WO2007066166A1 (fr) 2005-12-08 2005-12-08 Procede et systeme pour le traitement et l'affichage d'instructions de commande

Country Status (1)

Country Link
WO (1) WO2007066166A1 (fr)

Cited By (86)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009036782A1 (fr) * 2007-09-18 2009-03-26 Vrmedia S.R.L. Dispositif et procédé de traitement d'informations pour une assistance technique à distance
DE102008012122A1 (de) * 2008-03-01 2009-09-03 Rittal Gmbh & Co. Kg Prüfeinrichtung für Schaltschränke oder Racks
EP2273429A1 (fr) * 2009-07-06 2011-01-12 Siemens Aktiengesellschaft Système de communication et de soutien multimédia pouvant être installé partout dans le monde pour le montage, l'inspection, l'entretien et les réparations dans des installations techniques et procédé
WO2011120624A1 (fr) * 2010-03-30 2011-10-06 Khs Gmbh Unité de maintenance mobile
WO2012137108A1 (fr) * 2011-04-07 2012-10-11 International Business Machines Corporation Gestion de systèmes informatiques utilisant une réalité augmentée
EP2626756A1 (fr) * 2012-02-10 2013-08-14 Weber Maschinenbau GmbH Breidenbach Dispositif avec réalité augmentée
EP2642331A1 (fr) * 2012-03-21 2013-09-25 Converteam Technology Ltd Systèmes d'affichage et de commande
WO2013156342A1 (fr) * 2012-04-20 2013-10-24 Siemens Aktiengesellschaft Localisation d'un élément dans une installation industrielle au moyen d'un appareil de commande mobile
WO2013170871A1 (fr) * 2012-05-14 2013-11-21 Abb Research Ltd Procédé et système de commande industriel pour la maintenance d'équipements de processus industriels
WO2014000832A1 (fr) * 2012-06-25 2014-01-03 Robert Bosch Gmbh Dispositif de commande pour appareil de terrain de même que système et procédé de mise en service d'un appareil de terrain
WO2014048759A1 (fr) * 2012-09-27 2014-04-03 Krones Ag Procédé destiné à soutenir des processus de service et de conversion
EP2728846A1 (fr) * 2012-11-06 2014-05-07 Konica Minolta, Inc. Dispositif d'affichage d'informations de guidage
US20140152530A1 (en) * 2012-12-03 2014-06-05 Honeywell International Inc. Multimedia near to eye display system
WO2014127836A1 (fr) * 2013-02-25 2014-08-28 Abb Technology Ltd Méthode et dispositif de surveillance et de commande de processus industriel
WO2014184288A1 (fr) * 2013-05-15 2014-11-20 Thales Dispositif d'aide a la maintenance et procede de maintenance utilisant un tel dispositif
WO2015001233A1 (fr) * 2013-07-03 2015-01-08 Snecma Procede et systeme de realite augmentee pour la supervision
ITBO20130466A1 (it) * 2013-08-29 2015-03-01 Umpi Elettronica Societa A Respo Nsabilita Lim Metodo di ispezione e/o manutenzione di una parte di un impianto industriale mediante realta' aumentata, e corrispondente sistema per guidare l'ispezione e/o la manutenzione della parte di impianto industriale
EP2626758A3 (fr) * 2012-02-10 2015-03-04 Fisher-Rosemount Systems, Inc. Procédés pour assister de façon collaborative un opérateur de salle de contrôle
CN104508712A (zh) * 2012-05-15 2015-04-08 西门子公司 借助移动操作设备检验工业设备内的构件
EP2652940A4 (fr) * 2010-12-16 2015-05-20 Microsoft Technology Licensing Llc Contenu basé sur la compréhension et l'intention pour dispositifs d'affichage en réalité augmentée
WO2015101393A1 (fr) * 2013-12-30 2015-07-09 Telecom Italia S.P.A. Réalité augmentée pour supporter l'intervention d'un opérateur humain sur un appareil de réseau
WO2015160515A1 (fr) 2014-04-16 2015-10-22 Exxonmobil Upstream Research Company Procédés et systèmes pour fournir des procédures en temps réel
CN105103068A (zh) * 2013-04-18 2015-11-25 欧姆龙株式会社 作业管理系统及作业管理方法
EP2847753A4 (fr) * 2012-05-11 2015-12-16 Bosch Automotive Service Solutions Llc Système à rayons x virtuel pour automobile de réalité augmentée ayant des informations de service
EP2996015A1 (fr) * 2014-09-09 2016-03-16 Schneider Electric IT Corporation Procédé pour utiliser la réalité augmentée en tant qu'affichage hmi
US9323325B2 (en) 2011-08-30 2016-04-26 Microsoft Technology Licensing, Llc Enhancing an object of interest in a see-through, mixed reality display device
EP3086193A1 (fr) * 2015-04-24 2016-10-26 JPW Industries Inc. Affichage portable destiné à être utilisé avec un instrument
DE102015006632A1 (de) * 2015-05-21 2016-11-24 Audi Ag Verfahren zum Betreiben eines Diagnosesystems und Diagnosesystem für ein Kraftfahrzeug
WO2017100554A1 (fr) * 2015-12-11 2017-06-15 ecoATM, Inc. Systèmes et procédés pour recycler des dispositifs électroniques de consommateur
US9740935B2 (en) 2013-11-26 2017-08-22 Honeywell International Inc. Maintenance assistant system
EP3214586A1 (fr) * 2016-03-04 2017-09-06 Thales Deutschland GmbH Procédé pour support de maintenance et système de support de maintenance
ITUA20162756A1 (it) * 2016-04-20 2017-10-20 Newbiquity Sagl Metodo e sistema di assistenza a distanza in tempo reale con impiego di computer vision e realtà aumentata
WO2017182523A1 (fr) * 2016-04-20 2017-10-26 Newbiquity Sagl Procédé et système permettant un soutien à distance en temps réel avec utilisation de la vision artificielle et de la réalité augmentée
WO2017186450A1 (fr) * 2016-04-26 2017-11-02 Krones Ag Système de commande d'une machine s'utilisant dans l'industrie alimentaire
CN107422686A (zh) * 2016-04-06 2017-12-01 劳斯莱斯电力工程有限公司 用于允许对一个或更多个装置的远程控制的设备
US9885672B2 (en) 2016-06-08 2018-02-06 ecoATM, Inc. Methods and systems for detecting screen covers on electronic devices
US9911102B2 (en) 2014-10-02 2018-03-06 ecoATM, Inc. Application for device evaluation and other processes associated with device recycling
WO2018054976A1 (fr) * 2016-09-23 2018-03-29 Philips Lighting Holding B.V. Système d'immotique avec balise d'entretien
US9965564B2 (en) 2011-07-26 2018-05-08 Schneider Electric It Corporation Apparatus and method of displaying hardware status using augmented reality
US9965841B2 (en) 2016-02-29 2018-05-08 Schneider Electric USA, Inc. Monitoring system based on image analysis of photos
DE102017123940A1 (de) 2016-10-14 2018-05-09 Blach Verwaltungs GmbH + Co. KG Augmented-Reality bei Extruderanlage
US10019962B2 (en) 2011-08-17 2018-07-10 Microsoft Technology Licensing, Llc Context adaptive user interface for augmented reality display
EP3264209A4 (fr) * 2015-02-24 2018-07-25 Hallys Corporation Système de gestion de dispositif mécanique, dispositif de gestion de dispositif mécanique, serveur de gestion de dispositif mécanique, dispositif mécanique, et procédé de gestion de dispositif mécanique
US10127647B2 (en) 2016-04-15 2018-11-13 Ecoatm, Llc Methods and systems for detecting cracks in electronic devices
US10182153B2 (en) 2016-12-01 2019-01-15 TechSee Augmented Vision Ltd. Remote distance assistance system and method
US10223832B2 (en) 2011-08-17 2019-03-05 Microsoft Technology Licensing, Llc Providing location occupancy analysis via a mixed reality device
US10269110B2 (en) 2016-06-28 2019-04-23 Ecoatm, Llc Methods and systems for detecting cracks in illuminated electronic device screens
DE102017219067A1 (de) * 2017-10-25 2019-04-25 Bayerische Motoren Werke Aktiengesellschaft Vorrichtung und verfahren zur visuellen unterstützung eines benutzers in einem arbeitsumfeld
DE102017130138A1 (de) * 2017-12-15 2019-06-19 Endress+Hauser SE+Co. KG Verfahren zur vereinfachten Inbetriebnahme eines Feldgeräts
DE102017130137A1 (de) * 2017-12-15 2019-06-19 Endress+Hauser SE+Co. KG Verfahren zur vereinfachten Inbetriebnahme eines Feldgeräts
EP3502836A1 (fr) * 2017-12-21 2019-06-26 Atos Information Technology GmbH Procédé pour faire fonctionner un système de réalité interactive augmentée
WO2019123187A1 (fr) * 2017-12-20 2019-06-27 Nws Srl Procédé d'apprentissage virtuel
US10379607B2 (en) 2012-07-30 2019-08-13 Agilent Technologies, Inc. Experimental chamber with computer-controlled display wall
US10397404B1 (en) 2016-12-01 2019-08-27 TechSee Augmented Vision Ltd. Methods and systems for providing interactive support sessions
US10401411B2 (en) 2014-09-29 2019-09-03 Ecoatm, Llc Maintaining sets of cable components used for wired analysis, charging, or other interaction with portable electronic devices
US10417615B2 (en) 2014-10-31 2019-09-17 Ecoatm, Llc Systems and methods for recycling consumer electronic devices
DE102018204152A1 (de) * 2018-03-19 2019-09-19 Homag Gmbh System zur virtuellen Unterstützung einer Bedienperson für Holzbearbeitungsmaschinen
US10445708B2 (en) 2014-10-03 2019-10-15 Ecoatm, Llc System for electrically testing mobile devices at a consumer-operated kiosk, and associated devices and methods
US10475002B2 (en) 2014-10-02 2019-11-12 Ecoatm, Llc Wireless-enabled kiosk for recycling consumer devices
US10560578B2 (en) 2016-12-01 2020-02-11 TechSee Augmented Vision Ltd. Methods and systems for providing interactive support sessions
US10567584B2 (en) 2016-12-01 2020-02-18 TechSee Augmented Vision Ltd. Methods and systems for providing interactive support sessions
US10567583B2 (en) 2016-12-01 2020-02-18 TechSee Augmented Vision Ltd. Methods and systems for providing interactive support sessions
US10572946B2 (en) 2014-10-31 2020-02-25 Ecoatm, Llc Methods and systems for facilitating processes associated with insurance services and/or other services for electronic devices
WO2020049231A1 (fr) 2018-09-06 2020-03-12 Sidel Participations Procédé d'assistance par ordinateur dans la gestion d'une ligne de production
EP3660609A1 (fr) * 2018-11-09 2020-06-03 Liebherr-Verzahntechnik GmbH Pupitre de commande
WO2020146972A1 (fr) * 2019-01-14 2020-07-23 Covestro Deutschland Ag Méthode et système de contrôle d'un procédé de moulage par injection
US10789775B2 (en) 2016-07-15 2020-09-29 Beckhoff Automation Gmbh Method for controlling an object
US10860990B2 (en) 2014-11-06 2020-12-08 Ecoatm, Llc Methods and systems for evaluating and recycling electronic devices
US11010841B2 (en) 2008-10-02 2021-05-18 Ecoatm, Llc Kiosk for recycling electronic devices
US11080672B2 (en) 2014-12-12 2021-08-03 Ecoatm, Llc Systems and methods for recycling consumer electronic devices
US11080662B2 (en) 2008-10-02 2021-08-03 Ecoatm, Llc Secondary market and vending system for devices
US11107046B2 (en) 2008-10-02 2021-08-31 Ecoatm, Llc Secondary market and vending system for devices
US11112135B2 (en) 2018-11-09 2021-09-07 Johnson Controls Technology Company Maintenance procedure updating in HVAC system service log
US11127210B2 (en) 2011-08-24 2021-09-21 Microsoft Technology Licensing, Llc Touch and social cues as inputs into a computer
US11247869B2 (en) 2017-11-10 2022-02-15 Otis Elevator Company Systems and methods for providing information regarding elevator systems
US11462868B2 (en) 2019-02-12 2022-10-04 Ecoatm, Llc Connector carrier for electronic device kiosk
US11482067B2 (en) 2019-02-12 2022-10-25 Ecoatm, Llc Kiosk for evaluating and purchasing used electronic devices
US11526932B2 (en) 2008-10-02 2022-12-13 Ecoatm, Llc Kiosks for evaluating and purchasing used electronic devices and related technology
US11798250B2 (en) 2019-02-18 2023-10-24 Ecoatm, Llc Neural network based physical condition evaluation of electronic devices, and associated systems and methods
US11922467B2 (en) 2020-08-17 2024-03-05 ecoATM, Inc. Evaluating an electronic device using optical character recognition
US11989710B2 (en) 2018-12-19 2024-05-21 Ecoatm, Llc Systems and methods for vending and/or purchasing mobile phones and other electronic devices
US12033454B2 (en) 2020-08-17 2024-07-09 Ecoatm, Llc Kiosk for evaluating and purchasing used electronic devices
US12271929B2 (en) 2020-08-17 2025-04-08 Ecoatm Llc Evaluating an electronic device using a wireless charger
US12321965B2 (en) 2020-08-25 2025-06-03 Ecoatm, Llc Evaluating and recycling electronic devices
US12322259B2 (en) 2018-12-19 2025-06-03 Ecoatm, Llc Systems and methods for vending and/or purchasing mobile phones and other electronic devices
US12373801B2 (en) 2024-02-08 2025-07-29 Ecoatm, Llc System for electrically testing mobile devices at a consumer-operated kiosk, and associated devices and methods

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001002953A1 (fr) * 1999-07-06 2001-01-11 Abb Ab Procede d'integration d'une application dans un systeme informatise
US20020191002A1 (en) * 1999-11-09 2002-12-19 Siemens Ag System and method for object-oriented marking and associating information with selected technological components
US20040046711A1 (en) * 2000-12-18 2004-03-11 Siemens Ag User-controlled linkage of information within an augmented reality system
US20050021281A1 (en) * 2001-12-05 2005-01-27 Wolfgang Friedrich System and method for establising a documentation of working processes for display in an augmented reality system in particular in a production assembly service or maintenance enviroment
WO2005066744A1 (fr) * 2003-12-31 2005-07-21 Abb Research Ltd Panneau de commande virtuel

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001002953A1 (fr) * 1999-07-06 2001-01-11 Abb Ab Procede d'integration d'une application dans un systeme informatise
US20020191002A1 (en) * 1999-11-09 2002-12-19 Siemens Ag System and method for object-oriented marking and associating information with selected technological components
US20040046711A1 (en) * 2000-12-18 2004-03-11 Siemens Ag User-controlled linkage of information within an augmented reality system
US20050021281A1 (en) * 2001-12-05 2005-01-27 Wolfgang Friedrich System and method for establising a documentation of working processes for display in an augmented reality system in particular in a production assembly service or maintenance enviroment
WO2005066744A1 (fr) * 2003-12-31 2005-07-21 Abb Research Ltd Panneau de commande virtuel

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
ULRICH NEUMANN ET AL: "Natural Feature Tracking for Augmented Reality", IEEE TRANSACTIONS ON MULTIMEDIA, IEEE SERVICE CENTER, PISCATAWAY, NJ, US, vol. 1, no. 1, March 1999 (1999-03-01), XP011036279, ISSN: 1520-9210 *

Cited By (166)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009036782A1 (fr) * 2007-09-18 2009-03-26 Vrmedia S.R.L. Dispositif et procédé de traitement d'informations pour une assistance technique à distance
WO2009112063A2 (fr) 2007-09-18 2009-09-17 Vrmedia S.R.L. Appareil de traitement d'informations et procédé d'assistance technique à distance
WO2009112063A3 (fr) * 2007-09-18 2009-11-05 Vrmedia S.R.L. Appareil de traitement d'informations et procédé d'assistance technique à distance
DE102008012122A1 (de) * 2008-03-01 2009-09-03 Rittal Gmbh & Co. Kg Prüfeinrichtung für Schaltschränke oder Racks
DE102008012122B4 (de) * 2008-03-01 2014-09-11 Rittal Gmbh & Co. Kg Prüfeinrichtung für Schaltschränke oder Racks
US11107046B2 (en) 2008-10-02 2021-08-31 Ecoatm, Llc Secondary market and vending system for devices
US11790328B2 (en) 2008-10-02 2023-10-17 Ecoatm, Llc Secondary market and vending system for devices
US11526932B2 (en) 2008-10-02 2022-12-13 Ecoatm, Llc Kiosks for evaluating and purchasing used electronic devices and related technology
US11907915B2 (en) 2008-10-02 2024-02-20 Ecoatm, Llc Secondary market and vending system for devices
US11935138B2 (en) 2008-10-02 2024-03-19 ecoATM, Inc. Kiosk for recycling electronic devices
US12340425B2 (en) 2008-10-02 2025-06-24 Ecoatm, Llc Kiosk for recycling electronic devices
US12198108B2 (en) 2008-10-02 2025-01-14 Ecoatm, Llc Secondary market and vending system for devices
US11010841B2 (en) 2008-10-02 2021-05-18 Ecoatm, Llc Kiosk for recycling electronic devices
US11080662B2 (en) 2008-10-02 2021-08-03 Ecoatm, Llc Secondary market and vending system for devices
US12182773B2 (en) 2008-10-02 2024-12-31 Ecoatm, Llc Secondary market and vending system for devices
WO2011003727A1 (fr) * 2009-07-06 2011-01-13 Siemens Aktiengesellschaft Système d’assistance et de communication multimédia applicable à l’échelle mondiale, pour le montage, l’inspection, la maintenance et des interventions de réparation dans des installations techniques ainsi qu’un procédé
CN102473250A (zh) * 2009-07-06 2012-05-23 西门子公司 能在世界范围使用的用于在技术设备中进行装配、检查、维护和修理作业的多媒体通讯和支持系统以及方法
EP2273429A1 (fr) * 2009-07-06 2011-01-12 Siemens Aktiengesellschaft Système de communication et de soutien multimédia pouvant être installé partout dans le monde pour le montage, l'inspection, l'entretien et les réparations dans des installations techniques et procédé
WO2011120624A1 (fr) * 2010-03-30 2011-10-06 Khs Gmbh Unité de maintenance mobile
EP2652940A4 (fr) * 2010-12-16 2015-05-20 Microsoft Technology Licensing Llc Contenu basé sur la compréhension et l'intention pour dispositifs d'affichage en réalité augmentée
US9213405B2 (en) 2010-12-16 2015-12-15 Microsoft Technology Licensing, Llc Comprehension and intent-based content for augmented reality displays
WO2012137108A1 (fr) * 2011-04-07 2012-10-11 International Business Machines Corporation Gestion de systèmes informatiques utilisant une réalité augmentée
US9219666B2 (en) 2011-04-07 2015-12-22 International Business Machines Corporation Systems and methods for managing computing systems utilizing augmented reality
US8918494B2 (en) 2011-04-07 2014-12-23 International Business Machines Corporation Systems and methods for managing computing systems utilizing augmented reality
US9712413B2 (en) 2011-04-07 2017-07-18 Globalfoundries Inc. Systems and methods for managing computing systems utilizing augmented reality
US8738754B2 (en) 2011-04-07 2014-05-27 International Business Machines Corporation Systems and methods for managing computing systems utilizing augmented reality
GB2505099A (en) * 2011-04-07 2014-02-19 Ibm Managing computing systems utilizing augmented reality
US9219665B2 (en) 2011-04-07 2015-12-22 International Business Machines Corporation Systems and methods for managing computing systems utilizing augmented reality
US8990385B2 (en) 2011-04-07 2015-03-24 International Business Machines Corporation Systems and methods for managing computing systems utilizing augmented reality
US9391860B2 (en) 2011-04-07 2016-07-12 Globalfoundries, Inc.. Systems and methods for managing computing systems utilizing augmented reality
US9965564B2 (en) 2011-07-26 2018-05-08 Schneider Electric It Corporation Apparatus and method of displaying hardware status using augmented reality
US10019962B2 (en) 2011-08-17 2018-07-10 Microsoft Technology Licensing, Llc Context adaptive user interface for augmented reality display
US10223832B2 (en) 2011-08-17 2019-03-05 Microsoft Technology Licensing, Llc Providing location occupancy analysis via a mixed reality device
US11127210B2 (en) 2011-08-24 2021-09-21 Microsoft Technology Licensing, Llc Touch and social cues as inputs into a computer
US9323325B2 (en) 2011-08-30 2016-04-26 Microsoft Technology Licensing, Llc Enhancing an object of interest in a see-through, mixed reality display device
US9785133B2 (en) 2012-02-10 2017-10-10 Fisher-Rosemount Systems, Inc. Methods for collaboratively assisting a control room operator
EP2626756A1 (fr) * 2012-02-10 2013-08-14 Weber Maschinenbau GmbH Breidenbach Dispositif avec réalité augmentée
EP2626758A3 (fr) * 2012-02-10 2015-03-04 Fisher-Rosemount Systems, Inc. Procédés pour assister de façon collaborative un opérateur de salle de contrôle
EP2642331A1 (fr) * 2012-03-21 2013-09-25 Converteam Technology Ltd Systèmes d'affichage et de commande
WO2013156342A1 (fr) * 2012-04-20 2013-10-24 Siemens Aktiengesellschaft Localisation d'un élément dans une installation industrielle au moyen d'un appareil de commande mobile
EP2847753A4 (fr) * 2012-05-11 2015-12-16 Bosch Automotive Service Solutions Llc Système à rayons x virtuel pour automobile de réalité augmentée ayant des informations de service
WO2013170871A1 (fr) * 2012-05-14 2013-11-21 Abb Research Ltd Procédé et système de commande industriel pour la maintenance d'équipements de processus industriels
CN104508712A (zh) * 2012-05-15 2015-04-08 西门子公司 借助移动操作设备检验工业设备内的构件
CN104508712B (zh) * 2012-05-15 2017-06-20 首要金属科技德国有限责任公司 借助移动操作设备检验工业设备内的构件
WO2014000832A1 (fr) * 2012-06-25 2014-01-03 Robert Bosch Gmbh Dispositif de commande pour appareil de terrain de même que système et procédé de mise en service d'un appareil de terrain
US10379607B2 (en) 2012-07-30 2019-08-13 Agilent Technologies, Inc. Experimental chamber with computer-controlled display wall
US10642354B2 (en) 2012-07-30 2020-05-05 Agilent Technologies, Inc. Experimental chamber with computer-controlled display wall
CN104704432A (zh) * 2012-09-27 2015-06-10 克朗斯股份公司 用于支持操作和转换处理的方法
WO2014048759A1 (fr) * 2012-09-27 2014-04-03 Krones Ag Procédé destiné à soutenir des processus de service et de conversion
US9760168B2 (en) 2012-11-06 2017-09-12 Konica Minolta, Inc. Guidance information display device
EP2728846A1 (fr) * 2012-11-06 2014-05-07 Konica Minolta, Inc. Dispositif d'affichage d'informations de guidage
US20140152530A1 (en) * 2012-12-03 2014-06-05 Honeywell International Inc. Multimedia near to eye display system
CN104995573B (zh) * 2013-02-25 2018-04-13 Abb 技术有限公司 用于监视并控制工业过程的方法和装置
CN104995573A (zh) * 2013-02-25 2015-10-21 Abb技术有限公司 用于监视并控制工业过程的方法和装置
WO2014127836A1 (fr) * 2013-02-25 2014-08-28 Abb Technology Ltd Méthode et dispositif de surveillance et de commande de processus industriel
US9720402B2 (en) 2013-02-25 2017-08-01 Abb Schweiz Ag Method and device for monitoring and controlling an industrial process
US9953375B2 (en) 2013-04-18 2018-04-24 Omron Corporation Work management system and work management method
US9959578B2 (en) 2013-04-18 2018-05-01 Omron Corporation Work management system and work management method
US10019764B2 (en) 2013-04-18 2018-07-10 Omron Corporation Work management system and work management method
EP3001267A3 (fr) * 2013-04-18 2016-07-06 Omron Corporation Système de gestion de travail et procédé de gestion de travail
US9953376B2 (en) 2013-04-18 2018-04-24 Omron Corporation Work management system and work management method
US9953374B2 (en) 2013-04-18 2018-04-24 Omron Corporation Work management system and work management method
CN105103068A (zh) * 2013-04-18 2015-11-25 欧姆龙株式会社 作业管理系统及作业管理方法
EP3001269A3 (fr) * 2013-04-18 2016-07-06 Omron Corporation Système de gestion de travail et procédé de gestion de travail
EP3001270A3 (fr) * 2013-04-18 2016-07-06 Omron Corporation Système de gestion de travail et procédé de gestion de travail
EP2988184A4 (fr) * 2013-04-18 2016-07-13 Omron Tateisi Electronics Co Système de gestion de travail et procédé de gestion de travail
EP3001268A3 (fr) * 2013-04-18 2016-07-13 Omron Corporation Système de gestion de travail et procédé de gestion de travail
WO2014184288A1 (fr) * 2013-05-15 2014-11-20 Thales Dispositif d'aide a la maintenance et procede de maintenance utilisant un tel dispositif
FR3005819A1 (fr) * 2013-05-15 2014-11-21 Thales Sa Dispositif d'aide a la maintenance et procede de maintenance utilisant un tel dispositif
FR3008210A1 (fr) * 2013-07-03 2015-01-09 Snecma Procede et systeme de realite augmentee pour la supervision
WO2015001233A1 (fr) * 2013-07-03 2015-01-08 Snecma Procede et systeme de realite augmentee pour la supervision
WO2015028978A1 (fr) * 2013-08-29 2015-03-05 Umpi Elettronica - Societa' A Responsabilita' Limitata Procédé et système permettant l'inspection et/ou la maintenance d'un panneau électrique au moyen de la réalité augmentée
ITBO20130466A1 (it) * 2013-08-29 2015-03-01 Umpi Elettronica Societa A Respo Nsabilita Lim Metodo di ispezione e/o manutenzione di una parte di un impianto industriale mediante realta' aumentata, e corrispondente sistema per guidare l'ispezione e/o la manutenzione della parte di impianto industriale
US9740935B2 (en) 2013-11-26 2017-08-22 Honeywell International Inc. Maintenance assistant system
EP2876484B1 (fr) * 2013-11-26 2019-03-06 Honeywell International Inc. Système d'aide à la maintenance
US10171628B2 (en) 2013-12-30 2019-01-01 Telecom Italia S.P.A. Augmented reality for supporting intervention of a network apparatus by a human operator
WO2015101393A1 (fr) * 2013-12-30 2015-07-09 Telecom Italia S.P.A. Réalité augmentée pour supporter l'intervention d'un opérateur humain sur un appareil de réseau
WO2015160515A1 (fr) 2014-04-16 2015-10-22 Exxonmobil Upstream Research Company Procédés et systèmes pour fournir des procédures en temps réel
EP2996015A1 (fr) * 2014-09-09 2016-03-16 Schneider Electric IT Corporation Procédé pour utiliser la réalité augmentée en tant qu'affichage hmi
US10401411B2 (en) 2014-09-29 2019-09-03 Ecoatm, Llc Maintaining sets of cable components used for wired analysis, charging, or other interaction with portable electronic devices
US11126973B2 (en) 2014-10-02 2021-09-21 Ecoatm, Llc Wireless-enabled kiosk for recycling consumer devices
US10438174B2 (en) 2014-10-02 2019-10-08 Ecoatm, Llc Application for device evaluation and other processes associated with device recycling
US9911102B2 (en) 2014-10-02 2018-03-06 ecoATM, Inc. Application for device evaluation and other processes associated with device recycling
US12217221B2 (en) 2014-10-02 2025-02-04 Ecoatm, Llc Wireless-enabled kiosk for recycling consumer devices
US10496963B2 (en) 2014-10-02 2019-12-03 Ecoatm, Llc Wireless-enabled kiosk for recycling consumer devices
US10475002B2 (en) 2014-10-02 2019-11-12 Ecoatm, Llc Wireless-enabled kiosk for recycling consumer devices
US11734654B2 (en) 2014-10-02 2023-08-22 Ecoatm, Llc Wireless-enabled kiosk for recycling consumer devices
US11790327B2 (en) 2014-10-02 2023-10-17 Ecoatm, Llc Application for device evaluation and other processes associated with device recycling
US10445708B2 (en) 2014-10-03 2019-10-15 Ecoatm, Llc System for electrically testing mobile devices at a consumer-operated kiosk, and associated devices and methods
US11232412B2 (en) 2014-10-03 2022-01-25 Ecoatm, Llc System for electrically testing mobile devices at a consumer-operated kiosk, and associated devices and methods
US11989701B2 (en) 2014-10-03 2024-05-21 Ecoatm, Llc System for electrically testing mobile devices at a consumer-operated kiosk, and associated devices and methods
US12205081B2 (en) 2014-10-31 2025-01-21 Ecoatm, Llc Systems and methods for recycling consumer electronic devices
US10572946B2 (en) 2014-10-31 2020-02-25 Ecoatm, Llc Methods and systems for facilitating processes associated with insurance services and/or other services for electronic devices
US10417615B2 (en) 2014-10-31 2019-09-17 Ecoatm, Llc Systems and methods for recycling consumer electronic devices
US11436570B2 (en) 2014-10-31 2022-09-06 Ecoatm, Llc Systems and methods for recycling consumer electronic devices
US10860990B2 (en) 2014-11-06 2020-12-08 Ecoatm, Llc Methods and systems for evaluating and recycling electronic devices
US11315093B2 (en) 2014-12-12 2022-04-26 Ecoatm, Llc Systems and methods for recycling consumer electronic devices
US12008520B2 (en) 2014-12-12 2024-06-11 Ecoatm, Llc Systems and methods for recycling consumer electronic devices
US11080672B2 (en) 2014-12-12 2021-08-03 Ecoatm, Llc Systems and methods for recycling consumer electronic devices
EP3264209A4 (fr) * 2015-02-24 2018-07-25 Hallys Corporation Système de gestion de dispositif mécanique, dispositif de gestion de dispositif mécanique, serveur de gestion de dispositif mécanique, dispositif mécanique, et procédé de gestion de dispositif mécanique
EP3086193A1 (fr) * 2015-04-24 2016-10-26 JPW Industries Inc. Affichage portable destiné à être utilisé avec un instrument
US10685494B2 (en) 2015-04-24 2020-06-16 Jpw Industries Inc. Wearable display for use with tool
CN106066633A (zh) * 2015-04-24 2016-11-02 Jpw工业有限公司 与机床一起使用的可穿戴显示装置
US9972133B2 (en) 2015-04-24 2018-05-15 Jpw Industries Inc. Wearable display for use with tool
DE102015006632A1 (de) * 2015-05-21 2016-11-24 Audi Ag Verfahren zum Betreiben eines Diagnosesystems und Diagnosesystem für ein Kraftfahrzeug
WO2017100554A1 (fr) * 2015-12-11 2017-06-15 ecoATM, Inc. Systèmes et procédés pour recycler des dispositifs électroniques de consommateur
EP4099667A1 (fr) * 2015-12-11 2022-12-07 ecoATM, LLC Systèmes et procédés pour recycler des dispositifs électroniques de consommateur
US9965841B2 (en) 2016-02-29 2018-05-08 Schneider Electric USA, Inc. Monitoring system based on image analysis of photos
WO2017149120A1 (fr) * 2016-03-04 2017-09-08 Thales Deutschland Gmbh Procédé destiné au soutien de maintenance et système de soutien de maintenance
EP3214586A1 (fr) * 2016-03-04 2017-09-06 Thales Deutschland GmbH Procédé pour support de maintenance et système de support de maintenance
CN107422686B (zh) * 2016-04-06 2022-05-03 劳斯莱斯电力工程有限公司 用于允许对一个或更多个装置的远程控制的设备
CN107422686A (zh) * 2016-04-06 2017-12-01 劳斯莱斯电力工程有限公司 用于允许对一个或更多个装置的远程控制的设备
US10127647B2 (en) 2016-04-15 2018-11-13 Ecoatm, Llc Methods and systems for detecting cracks in electronic devices
ITUA20162756A1 (it) * 2016-04-20 2017-10-20 Newbiquity Sagl Metodo e sistema di assistenza a distanza in tempo reale con impiego di computer vision e realtà aumentata
WO2017182523A1 (fr) * 2016-04-20 2017-10-26 Newbiquity Sagl Procédé et système permettant un soutien à distance en temps réel avec utilisation de la vision artificielle et de la réalité augmentée
CN109074048A (zh) * 2016-04-26 2018-12-21 克朗斯股份公司 用于食品工业的机器的操作系统
US11199830B2 (en) 2016-04-26 2021-12-14 Krones Ag Operating system for a machine of the food industry
WO2017186450A1 (fr) * 2016-04-26 2017-11-02 Krones Ag Système de commande d'une machine s'utilisant dans l'industrie alimentaire
US9885672B2 (en) 2016-06-08 2018-02-06 ecoATM, Inc. Methods and systems for detecting screen covers on electronic devices
US10909673B2 (en) 2016-06-28 2021-02-02 Ecoatm, Llc Methods and systems for detecting cracks in illuminated electronic device screens
US11803954B2 (en) 2016-06-28 2023-10-31 Ecoatm, Llc Methods and systems for detecting cracks in illuminated electronic device screens
US10269110B2 (en) 2016-06-28 2019-04-23 Ecoatm, Llc Methods and systems for detecting cracks in illuminated electronic device screens
US10789775B2 (en) 2016-07-15 2020-09-29 Beckhoff Automation Gmbh Method for controlling an object
CN109791397B (zh) * 2016-09-23 2022-07-01 昕诺飞控股有限公司 具有维修信标的楼宇自动化系统
WO2018054976A1 (fr) * 2016-09-23 2018-03-29 Philips Lighting Holding B.V. Système d'immotique avec balise d'entretien
US11003152B2 (en) 2016-09-23 2021-05-11 Signify Holding B.V. Building automation system with servicing beacon
CN109791397A (zh) * 2016-09-23 2019-05-21 昕诺飞控股有限公司 具有维修信标的楼宇自动化系统
DE102017123940A1 (de) 2016-10-14 2018-05-09 Blach Verwaltungs GmbH + Co. KG Augmented-Reality bei Extruderanlage
US10313523B2 (en) 2016-12-01 2019-06-04 TechSee Augmented Vision Ltd. Remote distance assistance system and method
US11323568B2 (en) 2016-12-01 2022-05-03 TechSee Augmented Vision Ltd. Remote distance assistance system and method
US10805466B2 (en) 2016-12-01 2020-10-13 TechSee Augmented Vision Ltd. Remote distance assistance system and method
US10560578B2 (en) 2016-12-01 2020-02-11 TechSee Augmented Vision Ltd. Methods and systems for providing interactive support sessions
US10397404B1 (en) 2016-12-01 2019-08-27 TechSee Augmented Vision Ltd. Methods and systems for providing interactive support sessions
US10567584B2 (en) 2016-12-01 2020-02-18 TechSee Augmented Vision Ltd. Methods and systems for providing interactive support sessions
US10182153B2 (en) 2016-12-01 2019-01-15 TechSee Augmented Vision Ltd. Remote distance assistance system and method
US10567583B2 (en) 2016-12-01 2020-02-18 TechSee Augmented Vision Ltd. Methods and systems for providing interactive support sessions
DE102017219067A1 (de) * 2017-10-25 2019-04-25 Bayerische Motoren Werke Aktiengesellschaft Vorrichtung und verfahren zur visuellen unterstützung eines benutzers in einem arbeitsumfeld
US11247869B2 (en) 2017-11-10 2022-02-15 Otis Elevator Company Systems and methods for providing information regarding elevator systems
DE102017130138A1 (de) * 2017-12-15 2019-06-19 Endress+Hauser SE+Co. KG Verfahren zur vereinfachten Inbetriebnahme eines Feldgeräts
US11454533B2 (en) 2017-12-15 2022-09-27 Endress+Hauser SE+Co. KG Method for starting up a field device in a simplified manner
EP3724612B1 (fr) * 2017-12-15 2023-01-18 Endress+Hauser SE+Co. KG Procédé pour simplifier la mise en service d'un appareil de terrain
US11454942B2 (en) 2017-12-15 2022-09-27 Endress+Hauser SE+Co. KG Method for starting up a field device in a simplified manner
DE102017130137A1 (de) * 2017-12-15 2019-06-19 Endress+Hauser SE+Co. KG Verfahren zur vereinfachten Inbetriebnahme eines Feldgeräts
CN111512250A (zh) * 2017-12-20 2020-08-07 Nws(股份)责任有限公司 虚拟培训方法
WO2019123187A1 (fr) * 2017-12-20 2019-06-27 Nws Srl Procédé d'apprentissage virtuel
EP3502836A1 (fr) * 2017-12-21 2019-06-26 Atos Information Technology GmbH Procédé pour faire fonctionner un système de réalité interactive augmentée
DE102018204152A1 (de) * 2018-03-19 2019-09-19 Homag Gmbh System zur virtuellen Unterstützung einer Bedienperson für Holzbearbeitungsmaschinen
WO2020049231A1 (fr) 2018-09-06 2020-03-12 Sidel Participations Procédé d'assistance par ordinateur dans la gestion d'une ligne de production
EP3660609A1 (fr) * 2018-11-09 2020-06-03 Liebherr-Verzahntechnik GmbH Pupitre de commande
US11112135B2 (en) 2018-11-09 2021-09-07 Johnson Controls Technology Company Maintenance procedure updating in HVAC system service log
US11989710B2 (en) 2018-12-19 2024-05-21 Ecoatm, Llc Systems and methods for vending and/or purchasing mobile phones and other electronic devices
US12322259B2 (en) 2018-12-19 2025-06-03 Ecoatm, Llc Systems and methods for vending and/or purchasing mobile phones and other electronic devices
CN113423554A (zh) * 2019-01-14 2021-09-21 科思创知识产权两合公司 用于控制注射模制过程的方法和系统
WO2020146972A1 (fr) * 2019-01-14 2020-07-23 Covestro Deutschland Ag Méthode et système de contrôle d'un procédé de moulage par injection
EP3924161A4 (fr) * 2019-01-14 2022-11-30 Covestro Intellectual Property GmbH & Co. KG Méthode et système de contrôle d'un procédé de moulage par injection
US12300059B2 (en) 2019-02-12 2025-05-13 Ecoatm, Llc Kiosk for evaluating and purchasing used electronic devices
US11462868B2 (en) 2019-02-12 2022-10-04 Ecoatm, Llc Connector carrier for electronic device kiosk
US11482067B2 (en) 2019-02-12 2022-10-25 Ecoatm, Llc Kiosk for evaluating and purchasing used electronic devices
US11843206B2 (en) 2019-02-12 2023-12-12 Ecoatm, Llc Connector carrier for electronic device kiosk
US12223684B2 (en) 2019-02-18 2025-02-11 Ecoatm, Llc Neural network based physical condition evaluation of electronic devices, and associated systems and methods
US11798250B2 (en) 2019-02-18 2023-10-24 Ecoatm, Llc Neural network based physical condition evaluation of electronic devices, and associated systems and methods
US12033454B2 (en) 2020-08-17 2024-07-09 Ecoatm, Llc Kiosk for evaluating and purchasing used electronic devices
US12271929B2 (en) 2020-08-17 2025-04-08 Ecoatm Llc Evaluating an electronic device using a wireless charger
US11922467B2 (en) 2020-08-17 2024-03-05 ecoATM, Inc. Evaluating an electronic device using optical character recognition
US12321965B2 (en) 2020-08-25 2025-06-03 Ecoatm, Llc Evaluating and recycling electronic devices
US12373801B2 (en) 2024-02-08 2025-07-29 Ecoatm, Llc System for electrically testing mobile devices at a consumer-operated kiosk, and associated devices and methods

Similar Documents

Publication Publication Date Title
WO2007066166A1 (fr) Procede et systeme pour le traitement et l'affichage d'instructions de commande
CN113703569B (zh) 用于工业自动化的虚拟现实和增强现实的系统和方法
JP7110138B2 (ja) 作業指示システムおよび方法
US8225226B2 (en) Virtual control panel
US7787992B2 (en) Method to generate a human machine interface
US8677262B2 (en) Presentation of industrial automation data as a function of relevance to user
US8442933B2 (en) Web-based visualization mash-ups for industrial automation
US7110909B2 (en) System and method for establishing a documentation of working processes for display in an augmented reality system in particular in a production assembly service or maintenance environment
US7676294B2 (en) Visualization of workflow in an industrial automation environment
Zhang et al. RFID-assisted assembly guidance system in an augmented reality environment
US8533619B2 (en) Dynamically generating visualizations in industrial automation environment as a function of context and state information
US8026933B2 (en) Visualization system(s) and method(s) for preserving or augmenting resolution and data associated with zooming or paning in an industrial automation environment
US20090086021A1 (en) Dynamically generating real-time visualizations in industrial automation environment as a function of contect and state information
US20130010068A1 (en) Augmented reality system
US20090088883A1 (en) Surface-based computing in an industrial automation environment
US20100257464A1 (en) System and method for immersive operations intelligence
US20090089682A1 (en) Collaborative environment for sharing visualizations of industrial automation data
CN106340217A (zh) 基于增强现实技术的制造装备智能系统及其实现方法
US20200042793A1 (en) Creating, managing and accessing spatially located information utilizing augmented reality and web technologies
EP1975754B1 (fr) Procédé mis en oeuvre sur ordinateur pour afficher les données techniques pour surveiller une installation industrielle
Permin et al. Smart devices in production system maintenance
Saha et al. Emerging Technologies in Augmented Reality (AR) and Virtual Reality (VR) for Manufacturing Applications: A Comprehensive Review
Saha Augmented Reality (AR) and Virtual Reality (VR)-Based Data Visualization Frameworks for the Manufacturing Industry
Gadow Augmented Reality Based Maintenance Operations and Training
WO2023237939A1 (fr) Inspection industrielle utilisant la réalité augmentée

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
DPE2 Request for preliminary examination filed before expiration of 19th month from priority date (pct application filed from 20040101)
NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 05813837

Country of ref document: EP

Kind code of ref document: A1