EP2455936A4 - Speech translation system, dictionary server device, and program - Google Patents

Speech translation system, dictionary server device, and program Download PDF

Info

Publication number: EP2455936A4
Authority: EP; European Patent Office
Prior art keywords: program; server device; translation system; speech translation; dictionary server
Prior art date: 2009-07-16
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.): Granted

Application number

EP10799657.1A

Other languages

German (de)

French (fr)

Other versions

EP2455936A1 (en

EP2455936B1 (en

Inventor

Satoshi Nakamura

Eiichiro Sumita

Yutaka Ashikari

Noriyuki Kimura

Chiori Hori

Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)

National Institute of Information and Communications Technology

Original Assignee

National Institute of Information and Communications Technology

Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)

2009-07-16

Filing date

2010-03-03

Publication date

2018-01-10

2010-03-03 Application filed by National Institute of Information and Communications Technology filed Critical National Institute of Information and Communications Technology

2012-05-23 Publication of EP2455936A1 publication Critical patent/EP2455936A1/en

2018-01-10 Publication of EP2455936A4 publication Critical patent/EP2455936A4/en

2019-01-16 Application granted granted Critical

2019-01-16 Publication of EP2455936B1 publication Critical patent/EP2455936B1/en

Status Not-in-force legal-status Critical Current

2030-03-03 Anticipated expiration legal-status Critical

Classifications

- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/08—Speech classification or search
- G10L15/10—Speech classification or search using distance or distortion measures between unknown speech and reference templates
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/40—Processing or translation of natural language
- G06F40/58—Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/28—Constructional details of speech recognition systems
- G10L15/30—Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L13/00—Speech synthesis; Text to speech systems
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/26—Speech to text systems

Landscapes

Engineering & Computer Science (AREA)
Theoretical Computer Science (AREA)
Health & Medical Sciences (AREA)
Audiology, Speech & Language Pathology (AREA)
Physics & Mathematics (AREA)
Computational Linguistics (AREA)
General Health & Medical Sciences (AREA)
General Engineering & Computer Science (AREA)
General Physics & Mathematics (AREA)
Human Computer Interaction (AREA)
Multimedia (AREA)
Artificial Intelligence (AREA)
Acoustics & Sound (AREA)
Machine Translation (AREA)

EP10799657.1A 2009-07-16 2010-03-03 Speech translation system, dictionary server, and program Not-in-force EP2455936B1 (en)

Applications Claiming Priority (2)

Application Number	Priority Date	Filing Date	Title
JP2009167501A JP5471106B2 (en)	2009-07-16	2009-07-16	Speech translation system, dictionary server device, and program
PCT/JP2010/053418 WO2011007595A1 (en)	2009-07-16	2010-03-03	Speech translation system, dictionary server device, and program

Publications (3)

Publication Number	Publication Date
EP2455936A1 EP2455936A1 (en)	2012-05-23
EP2455936A4 true EP2455936A4 (en)	2018-01-10
EP2455936B1 EP2455936B1 (en)	2019-01-16

Family

ID=43449205

Family Applications (1)

Application Number	Title	Priority Date	Filing Date
EP10799657.1A Not-in-force EP2455936B1 (en)	2009-07-16	2010-03-03	Speech translation system, dictionary server, and program

Country Status (6)

Country	Link
US (1)	US9442920B2 (en)
EP (1)	EP2455936B1 (en)
JP (1)	JP5471106B2 (en)
KR (1)	KR101626887B1 (en)
CN (1)	CN102473413B (en)
WO (1)	WO2011007595A1 (en)

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number	Priority date	Publication date	Assignee	Title
CN102706343A (en) *	2012-06-01	2012-10-03	陈耀伦	Method, device and system based on Internet voice navigation
KR101834546B1 (en)	2013-08-28	2018-04-13	한국전자통신연구원	Terminal and handsfree device for servicing handsfree automatic interpretation, and method thereof
CN103533129B (en) *	2013-10-23	2017-06-23	上海斐讯数据通信技术有限公司	Real-time voiced translation communication means, system and the communication apparatus being applicable
KR101740332B1 (en) *	2013-11-05	2017-06-08	한국전자통신연구원	Apparatus and method for automatic tlanslation
JP2016133861A (en) *	2015-01-16	2016-07-25	株式会社ぐるなび	Information multilingual conversion system
JP2016177782A (en) *	2015-03-19	2016-10-06	パナソニックＩｐマネジメント株式会社	Wearable device and translation system
JP7000671B2 (en) *	2016-10-05	2022-01-19	株式会社リコー	Information processing system, information processing device, and information processing method
KR102384641B1 (en) *	2017-02-20	2022-04-08	엘지전자 주식회사	Method for controlling an intelligent system that performs multilingual processing
CN106998359A (en) *	2017-03-24	2017-08-01	百度在线网络技术（北京）有限公司	The method for network access and device of speech-recognition services based on artificial intelligence
US10826857B2 (en) *	2017-10-20	2020-11-03	Sap Se	Message processing for cloud computing applications
EP3559946B1 (en)	2018-03-07	2020-09-23	Google LLC	Facilitating end-to-end communications with automated assistants in multiple languages
US11403462B2 (en) *	2019-09-12	2022-08-02	Oracle International Corporation	Streamlining dialog processing using integrated shared resources
CN111274828B (en) *	2020-01-21	2021-02-02	陈刚	Language translation method, system, computer program and handheld terminal based on message leaving

Citations (3)

* Cited by examiner, † Cited by third party
Publication number	Priority date	Publication date	Assignee	Title
EP0311416A2 (en) *	1987-10-08	1989-04-12	Kabushiki Kaisha Toshiba	Translating communication system having central translating apparatus
US6345245B1 (en) *	1997-03-06	2002-02-05	Kabushiki Kaisha Toshiba	Method and system for managing a common dictionary and updating dictionary data selectively according to a type of local processing system
US20080255824A1 (en) *	2004-01-19	2008-10-16	Kabushiki Kaisha Toshiba	Translation Apparatus

Family Cites Families (40)

* Cited by examiner, † Cited by third party
Publication number	Priority date	Publication date	Assignee	Title
JPS6488875A (en)	1987-09-30	1989-04-03	Toshiba Corp	Voice translation device
GB2303955B (en) *	1996-09-24	1997-05-14	Allvoice Computing Plc	Data processing method and apparatus
JPH11328179A (en) *	1998-05-08	1999-11-30	Toshiba Corp	Dictionary management method and dictionary management system
CN1652107A (en) *	1998-06-04	2005-08-10	松下电器产业株式会社	Language conversion rule generating device, language conversion device and program recording medium
US6138099A (en) *	1998-10-19	2000-10-24	International Business Machines Corp.	Automatically updating language models
US6219638B1 (en) *	1998-11-03	2001-04-17	International Business Machines Corporation	Telephone messaging and editing system
JP2000148176A (en)	1998-11-18	2000-05-26	Sony Corp	Information processing device and method, serving medium, speech recognision system, speech synthesizing system, translation device and method, and translation system
JP2000194698A (en)	1998-12-25	2000-07-14	Sony Corp	Information processing device and method and information providing medium
JP2000259632A (en)	1999-03-09	2000-09-22	Toshiba Corp	Automatic interpretation system, interpretation program transmission system, recording medium, and information transmission medium
JP2001005488A (en) *	1999-06-18	2001-01-12	Mitsubishi Electric Corp	Voice interactive system
AU2001259446A1 (en) *	2000-05-02	2001-11-12	Dragon Systems, Inc.	Error correction in speech recognition
JP2002123282A (en)	2000-10-17	2002-04-26	Brother Ind Ltd	Translation device and recording medium
JP3581648B2 (en) *	2000-11-27	2004-10-27	キヤノン株式会社	Speech recognition system, information processing device, control method thereof, and program
JP2002245038A (en)	2001-02-21	2002-08-30	Ricoh Co Ltd	Multilanguage translation system by portable terminal equipment
US7493259B2 (en) *	2002-01-04	2009-02-17	Siebel Systems, Inc.	Method for accessing data via voice
US7369984B2 (en) *	2002-02-01	2008-05-06	John Fairweather	Platform-independent real-time interface translation by token mapping without modification of application code
US7013262B2 (en) *	2002-02-12	2006-03-14	Sunflare Co., Ltd	System and method for accurate grammar analysis using a learners' model and part-of-speech tagged (POST) parser
JP2003295893A (en) *	2002-04-01	2003-10-15	Omron Corp	System, device, method, and program for speech recognition, and computer-readable recording medium where the speech recognizing program is recorded
SE0202058D0 (en) *	2002-07-02	2002-07-02	Ericsson Telefon Ab L M	Voice browsing architecture based on adaptive keyword spotting
GB2395029A (en) *	2002-11-06	2004-05-12	Alan Wilkinson	Translation of electronically transmitted messages
DE10304229A1 (en) *	2003-01-28	2004-08-05	Deutsche Telekom Ag	Communication system, communication terminal and device for recognizing faulty text messages
JP2005055607A (en) *	2003-08-01	2005-03-03	Toyota Motor Corp	Server, information processing terminal, speech synthesis system
CN100547654C (en) *	2004-07-21	2009-10-07	松下电器产业株式会社	speech synthesis device
JP2006099296A (en) *	2004-09-29	2006-04-13	Nec Corp	Translation system, translation communication system, machine translation method and program
US7620549B2 (en) *	2005-08-10	2009-11-17	Voicebox Technologies, Inc.	System and method of supporting adaptive misrecognition in conversational speech
US7949529B2 (en) *	2005-08-29	2011-05-24	Voicebox Technologies, Inc.	Mobile systems and methods of supporting natural language human-machine interactions
JP4047885B2 (en) *	2005-10-27	2008-02-13	株式会社東芝	Machine translation apparatus, machine translation method, and machine translation program
US8719021B2 (en) *	2006-02-23	2014-05-06	Nec Corporation	Speech recognition dictionary compilation assisting system, speech recognition dictionary compilation assisting method and speech recognition dictionary compilation assisting program
US7756708B2 (en) *	2006-04-03	2010-07-13	Google Inc.	Automatic language model update
KR100859532B1 (en) *	2006-11-06	2008-09-24	한국전자통신연구원	Correspondence sentence pattern based automatic interpretation method and device
US8355915B2 (en) *	2006-11-30	2013-01-15	Rao Ashwin P	Multimodal speech recognition system
JP5121252B2 (en) *	2007-02-26	2013-01-16	株式会社東芝	Apparatus, method, and program for translating speech in source language into target language
US8676582B2 (en) *	2007-03-14	2014-03-18	Nec Corporation	System and method for speech recognition using a reduced user dictionary, and computer readable storage medium therefor
JP2008243080A (en)	2007-03-28	2008-10-09	Toshiba Corp	Device, method, and program for translating voice
US7634383B2 (en) *	2007-07-31	2009-12-15	Northrop Grumman Corporation	Prognosis adaptation method
CN101458681A (en)	2007-12-10	2009-06-17	株式会社东芝	Voice translation method and voice translation apparatus
JP5098613B2 (en) *	2007-12-10	2012-12-12	富士通株式会社	Speech recognition apparatus and computer program
JP3142002U (en)	2008-03-17	2008-05-29	隆司内山	Translation call system
US8326637B2 (en) *	2009-02-20	2012-12-04	Voicebox Technologies, Inc.	System and method for processing multi-modal device interactions in a natural language voice services environment
US9171541B2 (en) *	2009-11-10	2015-10-27	Voicebox Technologies Corporation	System and method for hybrid processing in a natural language voice services environment

2009
- 2009-07-16 JP JP2009167501A patent/JP5471106B2/en not_active Expired - Fee Related
2010
- 2010-03-03 US US13/383,742 patent/US9442920B2/en not_active Expired - Fee Related
- 2010-03-03 CN CN2010800312696A patent/CN102473413B/en not_active Expired - Fee Related
- 2010-03-03 WO PCT/JP2010/053418 patent/WO2011007595A1/en active Application Filing
- 2010-03-03 KR KR1020127001119A patent/KR101626887B1/en not_active Expired - Fee Related
- 2010-03-03 EP EP10799657.1A patent/EP2455936B1/en not_active Not-in-force

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number	Priority date	Publication date	Assignee	Title
EP0311416A2 (en) *	1987-10-08	1989-04-12	Kabushiki Kaisha Toshiba	Translating communication system having central translating apparatus
US6345245B1 (en) *	1997-03-06	2002-02-05	Kabushiki Kaisha Toshiba	Method and system for managing a common dictionary and updating dictionary data selectively according to a type of local processing system
US20080255824A1 (en) *	2004-01-19	2008-10-16	Kabushiki Kaisha Toshiba	Translation Apparatus

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
FEDERICO M ET AL: "Broadcast news LM adaptation over time", COMPUTER SPEECH AND LANGU, ELSEVIER, LONDON, GB, vol. 18, no. 4, 6 November 2003 (2003-11-06), pages 417 - 435, XP004572877, ISSN: 0885-2308, DOI: 10.1016/J.CSL.2003.10.001 *
See also references of WO2011007595A1 *

Also Published As

Publication number	Publication date
EP2455936A1 (en)	2012-05-23
WO2011007595A1 (en)	2011-01-20
KR20120040190A (en)	2012-04-26
JP2011022813A (en)	2011-02-03
US9442920B2 (en)	2016-09-13
JP5471106B2 (en)	2014-04-16
CN102473413A (en)	2012-05-23
US20120166176A1 (en)	2012-06-28
EP2455936B1 (en)	2019-01-16
CN102473413B (en)	2013-08-28
KR101626887B1 (en)	2016-06-13

Publication	Publication Date	Title
EP2455936A4 (en)	2018-01-10	Speech translation system, dictionary server device, and program
EP2437173A4 (en)	2012-05-09	Regular expression matching method and system, and searching device
EP2500862A4 (en)	2017-08-23	Fake-finger determination device, fake-finger determination method and fake-finger determination program
PL2503546T3 (en)	2016-11-30	Speech decoding device, speech decoding method, and speech decoding program
EP2628095A4 (en)	2018-01-10	Language identification in multilingual text
EP2457494A4 (en)	2017-05-24	Image processing device, image processing program and image processing method
SG175120A1 (en)	2011-11-28	Peri-critical reflection spectroscopy devices, systems, and methods
EP2350779A4 (en)	2018-01-10	Methods and systems for improved data input, compression, recognition, correction, and translation through frequency-based language analysis
EP2262278A4 (en)	2011-05-25	Speech processing device
EP2353108A4 (en)	2018-01-03	Method and system for analyzing text
EP2513635A4 (en)	2017-06-28	An on-line macrocontaminant analyser and method
EP2473950A4 (en)	2017-03-15	Method, apparatus and server for user verification
EP2431894A4 (en)	2012-03-28	Search method, device and system
EP2487772A4 (en)	2017-03-08	Control device, control device network, and control method
HK1153000A1 (en)	2012-03-16	Checking method, system and server for sql sentence sql
EP2515257A4 (en)	2016-12-07	Character recognition method, character recognition device, and character recognition program
EP2183684A4 (en)	2017-10-18	Coreference resolution in an ambiguity-sensitive natural language processing system
EP2504938A4 (en)	2017-05-17	Methods, systems and devices for providing fiber-to-the-desktop
EP2426643A4 (en)	2017-07-05	Object position inference device, object position inference method, and program
EP2631805A4 (en)	2018-02-28	Storage-service-provision device, system, service-provision method, and service-provision program
EP2426968A4 (en)	2017-04-12	Communication device, connection method, and connection program
EP2381415A4 (en)	2018-01-24	Person-judging device, method, and program
EP2450699A4 (en)	2017-05-17	Analysis device and analysis method
EP2466796A4 (en)	2012-06-20	User access method, system and access server, access device
EP2653981A4 (en)	2018-01-17	Natural language processing device, method, and program

Legal Events

Date	Code	Title	Description
2012-04-21	PUAI	Public reference made under article 153(3) epc to a published international application that has entered the european phase	Free format text: ORIGINAL CODE: 0009012
2012-05-23	17P	Request for examination filed	Effective date: 20120216
2012-05-23	AK	Designated contracting states	Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR
2012-10-24	DAX	Request for extension of the european patent (deleted)
2018-01-10	RA4	Supplementary search report drawn up and despatched (corrected)	Effective date: 20171207
2018-01-10	RIC1	Information provided on ipc code assigned before grant	Ipc: G10L 13/00 20060101ALN20171201BHEP Ipc: G10L 15/26 20060101ALN20171201BHEP Ipc: G06F 17/28 20060101AFI20171201BHEP
2018-05-25	STAA	Information on the status of an ep patent application or granted ep patent	Free format text: STATUS: EXAMINATION IS IN PROGRESS
2018-06-19	REG	Reference to a national code	Ref country code: DE Ref legal event code: R079 Ref document number: 602010056626 Country of ref document: DE Free format text: PREVIOUS MAIN CLASS: G10L0015100000 Ipc: G06F0017280000
2018-06-27	17Q	First examination report despatched	Effective date: 20180529
2018-07-02	GRAP	Despatch of communication of intention to grant a patent	Free format text: ORIGINAL CODE: EPIDOSNIGR1
2018-07-02	STAA	Information on the status of an ep patent application or granted ep patent	Free format text: STATUS: GRANT OF PATENT IS INTENDED
2018-07-25	RIC1	Information provided on ipc code assigned before grant	Ipc: G06F 17/28 20060101AFI20180619BHEP Ipc: G10L 15/26 20060101ALN20180619BHEP Ipc: G10L 13/00 20060101ALN20180619BHEP
2018-08-01	INTG	Intention to grant announced	Effective date: 20180703
2018-08-29	RAP1	Party data changed (applicant data changed or rights of an application transferred)	Owner name: NATIONAL INSTITUTE OF INFORMATION AND COMMUNICATIO
2018-11-07	GRAS	Grant fee paid	Free format text: ORIGINAL CODE: EPIDOSNIGR3
2018-12-14	GRAA	(expected) grant	Free format text: ORIGINAL CODE: 0009210
2018-12-14	STAA	Information on the status of an ep patent application or granted ep patent	Free format text: STATUS: THE PATENT HAS BEEN GRANTED
2019-01-16	AK	Designated contracting states	Kind code of ref document: B1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR
2019-01-16	REG	Reference to a national code	Ref country code: GB Ref legal event code: FG4D
2019-01-31	REG	Reference to a national code	Ref country code: CH Ref legal event code: EP
2019-02-06	REG	Reference to a national code	Ref country code: IE Ref legal event code: FG4D
2019-02-14	REG	Reference to a national code	Ref country code: DE Ref legal event code: R096 Ref document number: 602010056626 Country of ref document: DE
2019-02-15	REG	Reference to a national code	Ref country code: AT Ref legal event code: REF Ref document number: 1090225 Country of ref document: AT Kind code of ref document: T Effective date: 20190215
2019-04-30	PGFP	Annual fee paid to national office [announced via postgrant information from national office to epo]	Ref country code: DE Payment date: 20190321 Year of fee payment: 10 Ref country code: GB Payment date: 20190320 Year of fee payment: 10 Ref country code: FR Payment date: 20190322 Year of fee payment: 10
2019-05-22	REG	Reference to a national code	Ref country code: NL Ref legal event code: MP Effective date: 20190116
2019-06-10	REG	Reference to a national code	Ref country code: LT Ref legal event code: MG4D
2019-06-28	PG25	Lapsed in a contracting state [announced via postgrant information from national office to epo]	Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190116
2019-07-15	REG	Reference to a national code	Ref country code: AT Ref legal event code: MK05 Ref document number: 1090225 Country of ref document: AT Kind code of ref document: T Effective date: 20190116
2019-07-31	PG25	Lapsed in a contracting state [announced via postgrant information from national office to epo]	Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190116 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190416 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190116 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190116 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190116 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190516 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190116
2019-08-30	PG25	Lapsed in a contracting state [announced via postgrant information from national office to epo]	Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190116 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190516 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190416 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190417 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190116
2019-10-17	REG	Reference to a national code	Ref country code: DE Ref legal event code: R097 Ref document number: 602010056626 Country of ref document: DE
2019-10-31	PG25	Lapsed in a contracting state [announced via postgrant information from national office to epo]	Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190116 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190116 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190116 Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190116 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190116 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190116 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190116 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190116
2019-10-31	REG	Reference to a national code	Ref country code: CH Ref legal event code: PL
2019-11-22	PLBE	No opposition filed within time limit	Free format text: ORIGINAL CODE: 0009261
2019-11-22	STAA	Information on the status of an ep patent application or granted ep patent	Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT
2019-11-25	REG	Reference to a national code	Ref country code: DE Ref legal event code: R079 Ref document number: 602010056626 Country of ref document: DE Free format text: PREVIOUS MAIN CLASS: G06F0017280000 Ipc: G06F0040400000
2019-11-29	PG25	Lapsed in a contracting state [announced via postgrant information from national office to epo]	Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190116 Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190303
2019-12-13	REG	Reference to a national code	Ref country code: BE Ref legal event code: MM Effective date: 20190331
2019-12-25	26N	No opposition filed	Effective date: 20191017
2020-01-31	PG25	Lapsed in a contracting state [announced via postgrant information from national office to epo]	Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190331 Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190303 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190331
2020-02-28	PG25	Lapsed in a contracting state [announced via postgrant information from national office to epo]	Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190331 Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190116
2020-03-31	PG25	Lapsed in a contracting state [announced via postgrant information from national office to epo]	Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190116
2020-06-30	PG25	Lapsed in a contracting state [announced via postgrant information from national office to epo]	Ref country code: MT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190303
2020-10-01	REG	Reference to a national code	Ref country code: DE Ref legal event code: R119 Ref document number: 602010056626 Country of ref document: DE
2021-01-29	PG25	Lapsed in a contracting state [announced via postgrant information from national office to epo]	Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20201001 Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200331
2021-03-31	GBPC	Gb: european patent ceased through non-payment of renewal fee	Effective date: 20200303
2021-04-30	PG25	Lapsed in a contracting state [announced via postgrant information from national office to epo]	Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200303
2021-05-31	PG25	Lapsed in a contracting state [announced via postgrant information from national office to epo]	Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190116
2021-07-30	PG25	Lapsed in a contracting state [announced via postgrant information from national office to epo]	Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20100303
2022-06-30	PG25	Lapsed in a contracting state [announced via postgrant information from national office to epo]	Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190116