[go: up one dir, main page]

EP0751493A3 - Method and apparatus for reproducing speech signals and method for transmitting same - Google Patents

Method and apparatus for reproducing speech signals and method for transmitting same Download PDF

Info

Publication number
EP0751493A3
EP0751493A3 EP96304568A EP96304568A EP0751493A3 EP 0751493 A3 EP0751493 A3 EP 0751493A3 EP 96304568 A EP96304568 A EP 96304568A EP 96304568 A EP96304568 A EP 96304568A EP 0751493 A3 EP0751493 A3 EP 0751493A3
Authority
EP
European Patent Office
Prior art keywords
speech signals
encoding parameters
parameters
encoding
modified
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP96304568A
Other languages
German (de)
French (fr)
Other versions
EP0751493A2 (en
EP0751493B1 (en
Inventor
Masayuki C/O Sony Corporation Nishiguchi
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Corp
Original Assignee
Sony Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Corp filed Critical Sony Corp
Publication of EP0751493A2 publication Critical patent/EP0751493A2/en
Publication of EP0751493A3 publication Critical patent/EP0751493A3/en
Application granted granted Critical
Publication of EP0751493B1 publication Critical patent/EP0751493B1/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/10—Digital recording or reproducing
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/02—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/04—Time compression or expansion
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/08—Determination or coding of the excitation function; Determination or coding of the long-term prediction parameters
    • G10L19/10—Determination or coding of the excitation function; Determination or coding of the long-term prediction parameters the excitation function being a multipulse excitation
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L2019/0001—Codebooks
    • G10L2019/0012—Smoothing of parameters of the decoder interpolation

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Quality & Reliability (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
  • Reduction Or Emphasis Of Bandwidth Of Signals (AREA)
  • Transmission Systems Not Characterized By The Medium Used For Transmission (AREA)
  • Signal Processing Not Specific To The Method Of Recording And Reproducing (AREA)
  • Input Circuits Of Receivers And Coupling Of Receivers And Audio Equipment (AREA)
  • Telephone Function (AREA)

Abstract

An encoding unit 2 divides speech signals entering an input terminal 10 in terms of frames as units and encodes the divided signals on the frame basis to output encoding parameters such as line spectral pair (LSP) parameters, pitch, voiced (V)/ unvoiced (UV) or spectral amplitude Am. The modified encoding parameter calculating unit 3 interpolates the encoding parameters for calculating modified encoding parameters associated with desired time points. A decoding unit 6 synthesizes sine waves and the noise based upon the modified encoding parameters and outputs the synthesized speech signals at an output terminal 37. Speed control can be achieved easily at an arbitrary rate over a wide range with high sound quality with the phoneme and the pitch remaining unchanged.
EP96304568A 1995-06-20 1996-06-19 Method and apparatus for reproducing speech signals and method for transmitting same Expired - Lifetime EP0751493B1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP15372395A JP3747492B2 (en) 1995-06-20 1995-06-20 Audio signal reproduction method and apparatus
JP15372395 1995-06-20
JP153723/95 1995-06-20

Publications (3)

Publication Number Publication Date
EP0751493A2 EP0751493A2 (en) 1997-01-02
EP0751493A3 true EP0751493A3 (en) 1998-03-04
EP0751493B1 EP0751493B1 (en) 2001-08-29

Family

ID=15568696

Family Applications (1)

Application Number Title Priority Date Filing Date
EP96304568A Expired - Lifetime EP0751493B1 (en) 1995-06-20 1996-06-19 Method and apparatus for reproducing speech signals and method for transmitting same

Country Status (17)

Country Link
US (1) US5926788A (en)
EP (1) EP0751493B1 (en)
JP (1) JP3747492B2 (en)
KR (1) KR100472585B1 (en)
CN (1) CN1154976C (en)
AT (1) ATE205011T1 (en)
AU (1) AU721596B2 (en)
BR (1) BR9602835B1 (en)
CA (1) CA2179228C (en)
DE (1) DE69614782T2 (en)
ES (1) ES2159688T3 (en)
MX (1) MX9602391A (en)
MY (1) MY116532A (en)
RU (1) RU2255380C2 (en)
SG (1) SG54343A1 (en)
TR (1) TR199600519A2 (en)
TW (1) TW412719B (en)

Families Citing this family (45)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3707153B2 (en) * 1996-09-24 2005-10-19 ソニー株式会社 Vector quantization method, speech coding method and apparatus
US6202046B1 (en) 1997-01-23 2001-03-13 Kabushiki Kaisha Toshiba Background noise/speech classification method
JP4308345B2 (en) * 1998-08-21 2009-08-05 パナソニック株式会社 Multi-mode speech encoding apparatus and decoding apparatus
US6188980B1 (en) 1998-08-24 2001-02-13 Conexant Systems, Inc. Synchronized encoder-decoder frame concealment using speech coding parameters including line spectral frequencies and filter coefficients
US7272556B1 (en) * 1998-09-23 2007-09-18 Lucent Technologies Inc. Scalable and embedded codec for speech and audio signals
US6353808B1 (en) * 1998-10-22 2002-03-05 Sony Corporation Apparatus and method for encoding a signal as well as apparatus and method for decoding a signal
US6260009B1 (en) 1999-02-12 2001-07-10 Qualcomm Incorporated CELP-based to CELP-based vocoder packet translation
JP2000305599A (en) * 1999-04-22 2000-11-02 Sony Corp Speech synthesizing device and method, telephone device, and program providing media
US6260017B1 (en) * 1999-05-07 2001-07-10 Qualcomm Inc. Multipulse interpolative coding of transition speech frames
FR2796191B1 (en) * 1999-07-05 2001-10-05 Matra Nortel Communications AUDIO ENCODING AND DECODING METHODS AND DEVICES
US7092881B1 (en) * 1999-07-26 2006-08-15 Lucent Technologies Inc. Parametric speech codec for representing synthetic speech in the presence of background noise
US6535843B1 (en) * 1999-08-18 2003-03-18 At&T Corp. Automatic detection of non-stationarity in speech signals
US20040054525A1 (en) * 2001-01-22 2004-03-18 Hiroshi Sekiguchi Encoding method and decoding method for digital voice data
JP4680429B2 (en) * 2001-06-26 2011-05-11 Ｏｋｉセミコンダクタ株式会社 High speed reading control method in text-to-speech converter
JP4106624B2 (en) * 2001-06-29 2008-06-25 株式会社ケンウッド Apparatus and method for interpolating frequency components of a signal
US6907632B2 (en) * 2002-05-28 2005-06-21 Ferno-Washington, Inc. Tactical stretcher
US7523032B2 (en) * 2003-12-19 2009-04-21 Nokia Corporation Speech coding method, device, coding module, system and software program product for pre-processing the phase structure of a to be encoded speech signal to match the phase structure of the decoded signal
TWI498882B (en) 2004-08-25 2015-09-01 Dolby Lab Licensing Corp Audio decoder
KR20070051878A (en) * 2004-09-06 2007-05-18 마츠시타 덴끼 산교 가부시키가이샤 Scalable coding apparatus and scalable coding method
CN101203907B (en) 2005-06-23 2011-09-28 松下电器产业株式会社 Audio encoding apparatus, audio decoding apparatus and audio encoding information transmitting apparatus
JP2007150737A (en) * 2005-11-28 2007-06-14 Sony Corp Sound-signal noise reducing device and method therefor
AU2008215230B2 (en) 2007-02-14 2010-03-04 Lg Electronics Inc. Methods and apparatuses for encoding and decoding object-based audio signals
RU2463674C2 (en) * 2007-03-02 2012-10-10 Панасоник Корпорэйшн Encoding device and encoding method
EP2132733B1 (en) * 2007-03-02 2012-03-07 Telefonaktiebolaget LM Ericsson (publ) Non-causal postfilter
US8401865B2 (en) 2007-07-18 2013-03-19 Nokia Corporation Flexible parameter update in audio/speech coded signals
CN101971253B (en) * 2008-03-14 2012-07-18 松下电器产业株式会社 Encoding device, decoding device, and method thereof
JP4999757B2 (en) * 2008-03-31 2012-08-15 日本電信電話株式会社 Speech analysis / synthesis apparatus, speech analysis / synthesis method, computer program, and recording medium
CN101582263B (en) * 2008-05-12 2012-02-01 华为技术有限公司 Method and device for noise enhancement post-processing in speech decoding
US20100191534A1 (en) * 2009-01-23 2010-07-29 Qualcomm Incorporated Method and apparatus for compression or decompression of digital signals
CN102246229B (en) * 2009-04-03 2013-03-27 华为技术有限公司 Predicting method and apparatus for frequency domain pulse decoding and decoder
EP2242045B1 (en) * 2009-04-16 2012-06-27 Université de Mons Speech synthesis and coding methods
JP5316896B2 (en) * 2010-03-17 2013-10-16 ソニー株式会社 Encoding device, encoding method, decoding device, decoding method, and program
EP2830061A1 (en) 2013-07-22 2015-01-28 Fraunhofer Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus and method for encoding and decoding an encoded audio signal using temporal noise/patch shaping
BR112016008544B1 (en) * 2013-10-18 2021-12-21 Fraunhofer-Gesellschaft Zur Forderung Der Angewandten Forschung E.V. ENCODER TO ENCODE AND DECODER TO DECODE AN AUDIO SIGNAL, METHOD TO ENCODE AND METHOD TO DECODE AN AUDIO SIGNAL.
PL3058568T3 (en) 2013-10-18 2021-07-05 Fraunhofer Gesellschaft zur Förderung der angewandten Forschung e.V. Concept for encoding an audio signal and decoding an audio signal using speech related spectral shaping information
CN107369453B (en) * 2014-03-21 2021-04-20 华为技术有限公司 Method and device for decoding voice frequency code stream
WO2016142002A1 (en) 2015-03-09 2016-09-15 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Audio encoder, audio decoder, method for encoding an audio signal and method for decoding an encoded audio signal
CN106067996B (en) * 2015-04-24 2019-09-17 松下知识产权经营株式会社 Voice reproduction method, voice dialogue device
US10389994B2 (en) * 2016-11-28 2019-08-20 Sony Corporation Decoder-centric UV codec for free-viewpoint video streaming
JP6891662B2 (en) * 2017-06-23 2021-06-18 富士通株式会社 Voice evaluation program, voice evaluation method and voice evaluation device
CN108899008B (en) * 2018-06-13 2023-04-18 中国人民解放军91977部队 Method and system for simulating interference of noise in air voice communication
KR101971478B1 (en) 2018-09-27 2019-04-23 박기석 Blackout curtain device for vehicle
KR102150192B1 (en) 2019-04-04 2020-08-31 박기석 Blackout curtain device for vehicle
KR20230114981A (en) 2022-01-26 2023-08-02 주식회사 스마트름뱅이 Sunshield device for vehicle
CN114511474B (en) * 2022-04-20 2022-07-05 天津恒宇医疗科技有限公司 Method and system for reducing noise of intravascular ultrasound image, electronic device and storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0154381A2 (en) * 1984-03-07 1985-09-11 Koninklijke Philips Electronics N.V. Digital speech coder with baseband residual coding
US5038097A (en) * 1988-10-18 1991-08-06 Kabushiki Kaisha Kenwood Spectrum analyzer
WO1994001860A1 (en) * 1992-07-06 1994-01-20 Telefonaktiebolaget Lm Ericsson Time variable spectral analysis based on interpolation for speech coding

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2823023B2 (en) * 1990-09-10 1998-11-11 富士通株式会社 Connector Connection Method for Matrix Printed Board for Link Wiring
US5226108A (en) * 1990-09-20 1993-07-06 Digital Voice Systems, Inc. Processing a speech signal with estimated pitch
US5371853A (en) * 1991-10-28 1994-12-06 University Of Maryland At College Park Method and system for CELP speech coding and codebook for use therewith
US5327520A (en) * 1992-06-04 1994-07-05 At&T Bell Laboratories Method of use of voice message coder/decoder
US5479559A (en) * 1993-05-28 1995-12-26 Motorola, Inc. Excitation synchronous time encoding vocoder and method
US5602961A (en) * 1994-05-31 1997-02-11 Alaris, Inc. Method and apparatus for speech compression using multi-mode code excited linear predictive coding
US5729694A (en) * 1996-02-06 1998-03-17 The Regents Of The University Of California Speech coding, reconstruction and recognition using acoustics and electromagnetic waves
FR2863874B1 (en) * 2003-12-18 2006-03-17 Oreal CLEANSING COMPOSITION

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0154381A2 (en) * 1984-03-07 1985-09-11 Koninklijke Philips Electronics N.V. Digital speech coder with baseband residual coding
US5038097A (en) * 1988-10-18 1991-08-06 Kabushiki Kaisha Kenwood Spectrum analyzer
WO1994001860A1 (en) * 1992-07-06 1994-01-20 Telefonaktiebolaget Lm Ericsson Time variable spectral analysis based on interpolation for speech coding

Also Published As

Publication number Publication date
DE69614782T2 (en) 2002-05-02
KR100472585B1 (en) 2005-06-21
KR970003109A (en) 1997-01-28
CA2179228C (en) 2004-10-12
RU2255380C2 (en) 2005-06-27
US5926788A (en) 1999-07-20
CN1145512A (en) 1997-03-19
TR199600519A2 (en) 1997-01-21
BR9602835A (en) 1998-04-22
ES2159688T3 (en) 2001-10-16
SG54343A1 (en) 1998-11-16
MX9602391A (en) 1997-02-28
EP0751493A2 (en) 1997-01-02
BR9602835B1 (en) 2009-05-05
JP3747492B2 (en) 2006-02-22
MY116532A (en) 2004-02-28
AU5605496A (en) 1997-01-09
CN1154976C (en) 2004-06-23
AU721596B2 (en) 2000-07-06
DE69614782D1 (en) 2001-10-04
CA2179228A1 (en) 1996-12-21
JPH096397A (en) 1997-01-10
EP0751493B1 (en) 2001-08-29
ATE205011T1 (en) 2001-09-15
TW412719B (en) 2000-11-21

Similar Documents

Publication Publication Date Title
EP0751493A3 (en) Method and apparatus for reproducing speech signals and method for transmitting same
US5873059A (en) Method and apparatus for decoding and changing the pitch of an encoded speech signal
EP0770988B1 (en) Speech decoding method and portable terminal apparatus
KR101023460B1 (en) Signal Processing Method, Processing Unit and Voice Decoder
CN101578657B (en) Method and apparatus for getting attenuation factor
EP1141946B1 (en) Coded enhancement feature for improved performance in coding communication signals
EP0785541B1 (en) Usage of voice activity detection for efficient coding of speech
CA2169822A1 (en) Synthesis of speech using regenerated phase information
EP0843302B1 (en) Voice coder using sinusoidal analysis and pitch control
JPH1097296A (en) Method and device for voice coding, and method and device for voice decoding
EP1194925B1 (en) Bi-directional pitch enhancement in speech coding systems
JP2586043B2 (en) Multi-pulse encoder
AU3589100A (en) Speech synthesizer based on variable rate speech coding
JPH0411040B2 (en)
JP4230550B2 (en) Speech encoding method and apparatus, and speech decoding method and apparatus
JP3475958B2 (en) Speech encoding / decoding apparatus including speechless encoding, decoding method, and recording medium recording program
JPS62207036A (en) Voice coding system and its apparatus
JPH10105200A (en) Voice coding/decoding method
KR960030185A (en) How to adjust the pronunciation speed using the rest period length control
EP1164577A2 (en) Method and apparatus for reproducing speech signals
JPS6087400A (en) Multipulse type voice code encoder
JPS60260100A (en) Voice synthesizer
JPH05167457A (en) Voice coder
JPS6189737A (en) Voice analysis and synthesis device
JPS6097399A (en) Multipulse type vocoder

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT DE ES FR GB IT NL

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): AT DE ES FR GB IT NL

17P Request for examination filed

Effective date: 19980806

RIC1 Information provided on ipc code assigned before grant

Free format text: 7G 10L 21/04 A, 7G 10L 19/04 B, 7G 10L 11/06 B

GRAG Despatch of communication of intention to grant

Free format text: ORIGINAL CODE: EPIDOS AGRA

17Q First examination report despatched

Effective date: 20001025

GRAG Despatch of communication of intention to grant

Free format text: ORIGINAL CODE: EPIDOS AGRA

GRAH Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOS IGRA

GRAH Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOS IGRA

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT DE ES FR GB IT NL

REF Corresponds to:

Ref document number: 205011

Country of ref document: AT

Date of ref document: 20010915

Kind code of ref document: T

REF Corresponds to:

Ref document number: 69614782

Country of ref document: DE

Date of ref document: 20011004

REG Reference to a national code

Ref country code: ES

Ref legal event code: FG2A

Ref document number: 2159688

Country of ref document: ES

Kind code of ref document: T3

REG Reference to a national code

Ref country code: GB

Ref legal event code: IF02

ET Fr: translation filed
PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed
REG Reference to a national code

Ref country code: GB

Ref legal event code: 746

Effective date: 20120702

REG Reference to a national code

Ref country code: DE

Ref legal event code: R084

Ref document number: 69614782

Country of ref document: DE

Effective date: 20120614

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20140618

Year of fee payment: 19

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: ES

Payment date: 20140624

Year of fee payment: 19

Ref country code: IT

Payment date: 20140626

Year of fee payment: 19

Ref country code: NL

Payment date: 20140618

Year of fee payment: 19

Ref country code: AT

Payment date: 20140611

Year of fee payment: 19

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20140619

Year of fee payment: 19

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20150619

Year of fee payment: 20

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20150619

REG Reference to a national code

Ref country code: AT

Ref legal event code: MM01

Ref document number: 205011

Country of ref document: AT

Kind code of ref document: T

Effective date: 20150619

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20150619

REG Reference to a national code

Ref country code: NL

Ref legal event code: MM

Effective date: 20150701

REG Reference to a national code

Ref country code: FR

Ref legal event code: ST

Effective date: 20160229

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20150701

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20150619

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20150619

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20150630

REG Reference to a national code

Ref country code: DE

Ref legal event code: R071

Ref document number: 69614782

Country of ref document: DE

REG Reference to a national code

Ref country code: ES

Ref legal event code: FD2A

Effective date: 20160727

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20150620