WO2016166675A1 - Device and method for simulating a sound timbre, particularly for stringed electrical musical instruments - Google Patents

Device and method for simulating a sound timbre, particularly for stringed electrical musical instruments Download PDF

Info

Publication number
WO2016166675A1
WO2016166675A1 PCT/IB2016/052098 IB2016052098W WO2016166675A1 WO 2016166675 A1 WO2016166675 A1 WO 2016166675A1 IB 2016052098 W IB2016052098 W IB 2016052098W WO 2016166675 A1 WO2016166675 A1 WO 2016166675A1
Authority
WO
WIPO (PCT)
Prior art keywords
sound
simulating
musical instrument
electrical signal
source
Prior art date
Application number
PCT/IB2016/052098
Other languages
English (en)
French (fr)
Inventor
Filippo Zanetti
Original Assignee
Filippo Zanetti
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Filippo Zanetti filed Critical Filippo Zanetti
Priority to EP16719524.7A priority Critical patent/EP3284083A1/en
Priority to EP20169798.4A priority patent/EP3739569A1/en
Priority to US15/566,356 priority patent/US10115381B2/en
Publication of WO2016166675A1 publication Critical patent/WO2016166675A1/en
Priority to US16/173,336 priority patent/US20190066644A1/en

Links

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00Details of electrophonic musical instruments
    • G10H1/02Means for controlling the tone frequencies, e.g. attack or decay; Means for producing special musical effects, e.g. vibratos or glissandos
    • G10H1/06Circuits for establishing the harmonic content of tones, or other arrangements for changing the tone colour
    • G10H1/12Circuits for establishing the harmonic content of tones, or other arrangements for changing the tone colour by filtering complex waveforms
    • G10H1/125Circuits for establishing the harmonic content of tones, or other arrangements for changing the tone colour by filtering complex waveforms using a digital filter
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00Details of electrophonic musical instruments
    • G10H1/0091Means for obtaining special acoustic effects
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H3/00Instruments in which the tones are generated by electromechanical means
    • G10H3/12Instruments in which the tones are generated by electromechanical means using mechanical resonant generators, e.g. strings or percussive instruments, the tones of which are picked up by electromechanical transducers, the electrical signals being further manipulated or amplified and subsequently converted to sound by a loudspeaker or equivalent instrument
    • G10H3/14Instruments in which the tones are generated by electromechanical means using mechanical resonant generators, e.g. strings or percussive instruments, the tones of which are picked up by electromechanical transducers, the electrical signals being further manipulated or amplified and subsequently converted to sound by a loudspeaker or equivalent instrument using mechanically actuated vibrators with pick-up means
    • G10H3/18Instruments in which the tones are generated by electromechanical means using mechanical resonant generators, e.g. strings or percussive instruments, the tones of which are picked up by electromechanical transducers, the electrical signals being further manipulated or amplified and subsequently converted to sound by a loudspeaker or equivalent instrument using mechanically actuated vibrators with pick-up means using a string, e.g. electric guitar
    • G10H3/186Means for processing the signal picked up from the strings

Definitions

  • the present invention relates to a device and to a method for simulating a sound timbre of a stringed musical instrument.
  • the present invention relates to the simulation of a sound timbre belonging to a first electrical stringed musical instrument through the use of a second electrical stringed musical instrument.
  • Timbre is one of the acoustic-perceptive qualities of a sound, and specifically it is the quality that enables a listener to distinguish that sound from another. Two sounds that are formally identical in terms of tonal pitch, intensity and duration, can in fact be perceived with different timbre when they are emitted by different sound sources.
  • each instrument has its own timbre: the same note played on a violin or on a clarinet can be distinguished immediately.
  • the difference, in acoustic terms, is given by the wave form, which is the resultant of the sum of all the components of the ' complex signal.
  • a different composition of the signal determines the perception of a different timbre.
  • Pitches, intensities and durations are qualities of the sound that can be quantified and ordered along a scale, in that they are objective physical values that can be measured respectively with frequency meters, chronometers and sound-level meters.
  • the timbre cannot be either quantified or measured, since it is a multidimensional value.
  • timbre is explained by the fact that a sound, produced in any way, is never pure, i.e. it can never be represented with a sine curve, but it is instead made up of multiple vibrations called harmonics.
  • a note emitted by a musical instrument has a fundamental frequency, but several others are added to this.
  • Methods are known that make it possible to identify which other frequencies, in addition to the fundamental frequency, make up a note played on. a certain instrument. These methods identify the "spectrum" of a note, i.e. the frequency distribution of the sounds of that note.
  • harmonics in the spectrum of a note makes it possible to distinguish one instrument from another, or to recognize a same note played in different positions on a same instrument. For example, on a guitar a B played on the free string is perceived differently to a B played on the third string.
  • Such known technologies are usually implemented inside devices that are commonly used in combination with an electrical stringed musical instrument, such as for example amplifiers or pedal boards, or they are implemented directly in the electrical stringed musical instrument, be it a guitar, a bass guitar or a bowed instrument such as a violin.
  • these known devices generally use the functionality offered by a hexaphonic guitar pickup, located at the bridge of the guitar in addition to the monophonic pickups.
  • hexaphonic pickups are located at the bridge of the guitar because they start from a sound that is rich in harmonics, i.e. from a standard reference sound.
  • Devices for modifying the sound timbre of an electrical musical instrument, which are adapted to mathematically model the distance of the pickups, whether they are monophonic or hexaphonic, from the bridge of the instrument, such modeling taking place in the time domain, in particular by acting on delays.
  • the sound timbre is influenced by a plurality of factors.
  • a first factor is constituted for example by the characteristics of the musical instrument played, such as the shape of the harmonic body, the type of wood, the type of pickup used, for example single coil or humbucking, and the position of the pickup, for example in the bridge or in the neck.
  • a second factor is determined by the characteristics of the strings used, which differ in terms of quality, thickness, and state of wear. Other factors are ascribable to the adjustment of the tone and volume knobs, or to the player's technique, which can vary for example according to the shape and thickness of the plectrum, the intensity of the picking, the use of pizzicato techniques with the fingernails or with the fingertips, use of an e-bow, and so on.
  • EPA 2,372,692 describes a technology for imparting the resonance effect of an acoustic stringed musical instrument to an amplified audio signal, acoustic resonance being a typical characteristic of the acquisition or registration of sound by way of a microphone.
  • the aim of the present invention is to overcome the above mentioned drawbacks of the known art, by devising a device and a method for simulating a sound timbre, particularly for stringed electrical musical instruments, which make it possible to obtain effects similar to the effects that can be obtained with known solutions, by making it possible to modify the sound timbre of a first electrical stringed musical instrument, herein referred to as the source instrument, until it is made wholly identical to the sound timbre of a second stringed musical instrument, herein referred to as the target instrument.
  • an object of the present invention is to devise a device and a method for simulating a sound timbre which allow the use of any model of stringed musical instrument, for example any model of electric guitar, to simulate the musical timbre of another model of stringed musical instrument of the same type and, within certain limits, even of another type.
  • Another object of the present invention is to devise a device and a method for simulating a sound timbre which do not require a hexaphonic pickup, or even a dedicated stringed musical instrument, with consequent advantages in terms of economic savings (the purchase is avoided of an additional component, or of a new instrument) and time savings (for example for assembly), and thus avoiding having to provide an adapted electric power supply, for example by way of a battery, for the electronic components inside the electrical stringed musical instrument.
  • Another object of the present invention is to devise a device and a method for simulating a sound timbre which make it possible to calculate for each pair of stringed electrical musical instruments, for example for each pair constituted by a source electric guitar and a target electric guitar, the modifications to apply to the electrical signal of the first (source) stringed musical instrument in order to obtain the same sound timbre as the second (target) stringed musical instrument.
  • Another object of the present invention is to devise a device and a method for simulating a sound timbre which make it possible to simulate, in addition to the sound timbre of a target electrical stringed musical instrument, the technique of the player who is playing the instrument as well, so that, for example, for the same technique, a simulation can be performed between different instruments, each one characterized by determined strings and tone/volume settings, or, if playing the same instrument, one can simulate a sound timbre deriving from different tone and/or volume settings, or a sound timbre deriving from different playing techniques, for example using a rounded or pointed plectrum, or using pizzicato with the fingernails instead of with the fingertips.
  • Another object of the present invention is to devise a device and a method for simulating a sound timbre which do not have any mathematical model for the identification and consequent processing of the position of the pickup of the electrical stringed musical instrument, be they of the monophonic type or of the hexaphonic type.
  • Another object of the present invention is to devise a device and a method for simulating a sound timbre which make it possible to use a monophonic pickup, thus ensuring a greater resonance effect between the strings of the musical instrument and a greater sensitivity to touch.
  • Another object of the present invention is to provide a device and a method for simulating a sound timbre which are highly reliable, easily and practically implemented and low cost.
  • a device for simulating a sound timbre particularly for stringed electrical musical instruments, which comprises means for acquiring an input electrical signal generated by the vibrations of the strings of a musical instrument, and filtering means which operate on said electrical signal generated by a source musical instrument, characterized in that said filtering means apply to said electrical signal generated by said source musical instrument a transfer function obtained by correlating the sound profile of a target musical instrument to the sound profile of said source musical instrument, said sound profiles comprising respectively the average frequency spectrum of a range of notes played on said target musical instrument and the average frequency spectrum of a corresponding range of notes played on said source musical instrument, and said sound profiles being defined on the basis of said electrical signals generated by said musical instruments, corresponding to the playing of at least one note per string, covering at least one tenth of the range of extension of said musical instruments.
  • a method for simulating a sound timbre particularly for stringed electrical musical instruments, characterized in that it comprises the steps that consist of: acquiring an input electrical signal generated by the vibrations of the strings of a source musical instrument; obtaining a transfer function by correlating the sound profile of a target musical instrument to the sound profile of said source musical instrument, said sound profiles comprising respectively the average frequency spectrum of a range of notes played on said target musical instrument and the average frequency spectrum of a corresponding range of notes played on said source musical instrument; and filtering said electrical signal generated by said source musical instrument, applying said transfer function to said electrical signal.
  • sound profile means a set of characteristics related to the harmonic content and amplitude envelope of a sound, which determine its particular timbre.
  • the above mentioned average frequency spectrum is obtained by way of calculating the average value of the spectral envelopes for sounds of different pitch.
  • a device for simulating a sound timbre particularly for stringed electrical musical instruments, according to the other appended independent claims.
  • Figure 1 is a block diagram showing a possible embodiment of the device for simulating a sound timbre, particularly for stringed electrical musical instruments, according to the present invention
  • Figure 2 is a flowchart showing the operation of a possible embodiment of the device for simulating a sound timbre, according to the present invention, in particular with regard to the learning procedure;
  • Figure 3 is a flowchart showing the operation of a possible embodiment of the device for simulating a sound timbre, according to the present invention, shown in Figure 1 , in particular with regard to the playing procedure;
  • Figure 4 is a graph showing the progression over time of the electrical signal generated by a stringed musical instrument, in particular by an electric guitar;
  • Figure 5 is a graph showing the spectral representations, i.e. the frequency distributions, of the characteristic electrical signals of a pair of stringed electrical musical instruments, in particular a source electric guitar and a target electric guitar, and the associated transfer function;
  • Figure 6 is a graph showing the progression over time of the four steps that make up the envelope: Attack, Decay, Sustain, Release, commonly grouped in the acronym ADSR;
  • Figure 7 is a graph showing the amplitude envelopes of a note played with two different playing techniques, for example using a plectrum and using pizzicato;
  • Figure 8 is a graph showing a pair of spectral transfer functions for simulating a target electric guitar starting from a source electric guitar, and a third spectral transfer function freely redefined starting from such spectral transfer functions.
  • the device for simulating a sound timbre substantially comprises means 20 for acquiring a first, input electrical signal, an analog-to-digital converter 25, processing means 30, a memory 40 for storing sound profiles 42, 43, 44 or 45, a selector or selection means 35 for selecting a sound profile, filtering means 50, amplitude modulation means 52, and means 55 for producing a second, output electrical signal.
  • the example that will be given of the device 10 for simulating a sound timbre, particularly for stringed electrical musical instruments, will be specifically electric guitars.
  • the input means 20 acquire an analog electrical signal originating, by way of a connection cable, from an electric guitar 12, 13, 14 or 15 played by a user, such analog electrical signal being generated in particular by the pickups of the electric guitar, for example by a polyphonic pickup.
  • the input means 20 can acquire an analog electrical signal generated by a microphone, which captures the audio emitted by acoustic stringed musical instruments, such as in particular acoustic guitars.
  • the electrical signal generated by an electric guitar 12, 13, 14 or 15 and acquired by the input means 20 is subsequently sent to the analog-to- digital converter 25, which is an electronic circuit capable of converting an analog electrical signal with continuous progression, specifically a voltage, to a series of discrete values.
  • the processing means 30, typically constituted by a processor or CPU, process the electrical signal, which is now digital, thus defining a sound profile 42, 43, 44 or 45 that corresponds to the electric guitar 12, 13, 14 or 15 from which the electrical signal originated.
  • Each one of the sound profiles 42, 43, 44 or 45 comprises the spectrum, i.e. the frequency distribution, of the electrical signal originating from the electric guitar 12, 13, 14 or 15, and such spectrum identifies the sound timbre corresponding to a specific electric guitar 12, 13, 14 or 15.
  • the sound profiles 42, 43, 44 or 45 corresponding to the electric guitars 12, 13, 14 or 15 further comprise characteristics of the model of musical instrument and/or of the configuration of use of the musical instrument.
  • These characteristics can comprise the model of stringed musical instrument, the type and/or the position of the pickup (for example single coil pickup at the bridge), the type and/or the scaling of the strings, the position of the volume/tone potentiometer, and the playing technique (for example with a plectrum or using pizzicato).
  • this sound profile is saved in an adapted memory 40, for example an EEPROM, for storing the sound profiles 42, 43, 44 or 45.
  • the device 10 for simulating a sound timbre is capable of executing a "learning" procedure, in order to define and store a certain number of sound profiles 42, 43, 44 or 45, each one corresponding to a different electric guitar 12, 13, 14 or 15.
  • the sound profile 42, 43, 44 or 45 is not defined by the processing means 30 comprised in the device 10 proper, but is defined by a remote computer of the server type which is connected, for example through a telematic communications network like the internet, to the device 10 and to which the processing means 30 delegate the processing.
  • the user plays at least one note for each string, for example on the electric guitar 12, covering a significant portion of the range of extension of the instrument, and the device 10 for simulating a sound timbre acquires and converts the electrical signal generated by the electric guitar 12 being played and, on the basis of such electrical signal, it defines and stores a sound profile 42 that corresponds to the electric guitar 12.
  • the various notes produced by the user's playing can be emitted individually, i.e. one at a time, or they can be emitted simultaneously, i.e. two or more at a time, such as for example bichords, trichords and so on, or chord sounds in general. Note, however, that better sound profiles can be obtained by starting from individual notes or sounds.
  • the learning procedure weighs the contribution of the different strings equally for the calculation of the average frequency spectrum comprised in the sound profiles 42, 43, 44 and 45 of the electric guitars 12, 13, 14 and 15, even if the number of notes played is not the same for each string.
  • the user plays the same number of notes for each string. Therefore, in this case, the sound profiles 42, 43, 44 and 45 are defined by playing the same number of notes for each string.
  • the user plays notes that belong to a chromatic scale. Therefore, in this case, the sound profiles 42, 43, 44 and 45 are defined by playing notes that belong to a chromatic scale.
  • the user plays the same sequence of notes, typically a preset sequence, with all the different electric guitars 12, 13, 14 and 15, so that all the corresponding sound profiles 42, 43, 44 and 45 are defined on the basis of the same sequence of notes.
  • sequence of notes typically a preset sequence
  • all the different electric guitars 12, 13, 14 and 15 so that all the corresponding sound profiles 42, 43, 44 and 45 are defined on the basis of the same sequence of notes.
  • the respective spectra of the above mentioned sound profiles 42, 43, 44 or 45 corresponding to the above mentioned electric guitars 12, 13, 14 or 15, are defined according to the following method.
  • the recording occurs preferably using samples of at least 16 bits recorded with a frequency of at least 10 kHz, playing at least one note per string for N notes in total, preferably playing the same number of notes for each string and covering the entire range of extension of the instrument.
  • the sounds i.e. the respective electrical signals, corresponding to the N notes played, are then normalized with reference to a maximum amplitude set to 1.
  • the averages are calculated of the peaks for the various sounds, i.e. at the various frequencies, and then a linear interpolation, or an interpolation using a spline function, is performed on such averages, preferably weighing the contribution of the different strings equally, thus obtaining the complete spectrum of the instrument, and finally this is filtered in order to obtain a characteristic "smooth" spectrum.
  • a spline is a function, constituted by a set of mutually connected polynomials, the purpose of which is to interpolate in a range a set of points (called nodes of the spline), so that the function is continuous at least up to a given order of derivatives at every point in the range.
  • the respective spectra of the above mentioned sound profiles 42, 43, 44 or 45 corresponding to the above mentioned electric guitars 12, 13, 14 or 15,- are defined according to other methods, such as for example estimating the spectrum of the electrical signal by way of cepstrum, mel-cepstrum, or LPC.
  • the user must first select the sound profile 43 of the electric guitar 13 (target), i.e. the sound profile that corresponds to the electric guitar whose sound timbre and texture the user wants to simulate.
  • target i.e. the sound profile that corresponds to the electric guitar whose sound timbre and texture the user wants to simulate.
  • Such selection of the sound profile 43 desired occurs by way of a selector 35, which is comprised in the device 10 for simulating a sound timbre and is constituted, for example, by a switch or by a knob, if the interface is mechanical, or by a graphic element, for example a graphic button or an icon, if the interface is electronic, for example a touch screen, or a computer program.
  • the input means 20 acquire an analog electrical signal originating, by way of an adapted connection cable, from the electric guitar 15 being played by the user.
  • the electrical signal generated by the electric guitar 15 and acquired by the input means 20 is subsequently sent to the analog-to-digital converter 25 and converted thereby to a series of discrete values.
  • the processing means 30, which as mentioned are typically constituted by a CPU, process the electrical signal, which is now digital, identifying the corresponding sound profile 45 that corresponds to the electric guitar 15, which was previously learned, i.e. defined and stored, by the device 10.
  • the device 10 for simulating a sound timbre is configured to require the user to play a preset sequence of notes, in order to identify the sound profile 45 of the source musical instrument 15.
  • the preset sequence of notes to be played which is requested by the device 10 to the user, is the same sequence used in the learning procedure to define the sound profile 42, 43 or 44 of the target musical instrument 12, 13 or 14.
  • the device 10 for simulating a sound timbre is further configured to verify the correct playing by the user of such required preset sequence of notes.
  • the processing means 30 of the device 10 When the processing means 30 of the device 10 have access to the information for the sound profile 45 of the source electric guitar 15, which is currently being played by the user, and to the information for the sound profile 43 of the target electric guitar 13, the sound timbre of which the user wants to simulate, the information for both of the sound profiles 45 and 43 being accessible from the storage memory 40, then the processing means 30 can calculate a transfer function by way of which the device 10 is capable of modifying the electrical signal generated by the electric guitar 15 being played by the user, in order to optimally simulate the sound timbre of the electric guitar 13 although the user is actually playing the electric guitar 15.
  • the processing means 30 calculate a transfer function for each individual string. In another embodiment of the device 10 for simulating a sound timbre, the processing means 30 calculate a transfer function for a set of strings, for example if a polyphonic pickup is used.
  • such transfer function calculated by the processing means 30, is applied by the device 10 to the electrical signal generated by the electric guitar 15 being played by the user by acting on the filtering means 50.
  • the filtering means 50 comprise an analog circuit, or analog-to-digital circuit, which is adapted to approximate the characteristics of the filter.
  • the above mentioned transfer function for modifying the electrical signal generated by the source electric guitar, is given by the ratio to the various frequencies among the average characteristic spectral representations of the electrical signals generated by the source and target electric guitars.
  • the spectral representations of the transfer function 200 is given by the ratio between the average characteristic spectral representation 205 ⁇ ( ⁇ ) of the electrical signal generated by the target electric guitar, i.e. the electric guitar whose sound timbre the user wishes to simulate, and the average characteristic spectral representation 210 B(co) of the electrical signal generated by the source electric guitar, i.e. the electric guitar that the user intends to actually play.
  • the transfer function of the filter 50 is variable as a function of the time, i.e. a different transfer function is applied according to the time t that has elapsed since the moment when the sound began.
  • the transfer function is not calculated by processing the average value of the identified peaks, with Z varying from 1 to the number of sampling intervals n as previously described; rather, a different transfer function is stored for each sampling moment Z. In this manner, at the time of simulation, it is possible to apply the transfer function for the sample Z that corresponds to the time of execution.
  • the device 10 for simulating a sound timbre another factor that can be considered is the envelope (ADSR - Attack, Decay, Sustain, Release) of the sounds, in particular where the goal is to simulate the sound timbre of a stringed musical instrument of a different type or family to the type or family of the stringed musical instrument actually being played by the user, for example in order to simulate the sound timbre of an electric bass guitar, of a violin or of a piano by playing an electric guitar, or vice versa.
  • ADSR - Attack, Decay, Sustain, Release the envelope of the sounds, in particular where the goal is to simulate the sound timbre of a stringed musical instrument of a different type or family to the type or family of the stringed musical instrument actually being played by the user, for example in order to simulate the sound timbre of an electric bass guitar, of a violin or of a piano by playing an electric guitar, or vice versa.
  • the envelope of the sounds can also be considered if the goal is to simulate the sound timbre of a non-stringed musical instrument, for example a wind instrument, and therefore evidently an instrument of a different type or family to the type or family of the stringed musical instrument actually being played by the user, for example in order to simulate the sound timbre of a flute, of a clarinet or of a trumpet by playing an electric guitar.
  • a non-stringed musical instrument for example a wind instrument
  • an instrument of a different type or family to the type or family of the stringed musical instrument actually being played by the user for example in order to simulate the sound timbre of a flute, of a clarinet or of a trumpet by playing an electric guitar.
  • the transfer function, applied to filter the electrical signal generated by the source musical instrument undergoes further processing before being applied, according to the following method.
  • First of all the ADSR is determined of the sounds of both of the stringed musical instruments, i.e. of the source instrument and of the target instrument, and the corresponding rADSR ratios between the sounds of the two stringed musical instruments, at the same pitch, are determined, by carrying out the following steps for each sound:
  • the amplitude modulation means 52 amplitude modulate the filtered electrical signal, thus modifying the envelope of the sound of the source musical instrument; such amplitude modulating occurs by applying the gains that were calculated previously, in particular on the basis of the time since the Attack of the envelope of the sound of the source stringed musical instrument.
  • the filtering means 50 can comprise a FIR filter (Finite Impulse Response), optionally minimum phase.
  • FIR filter Finite Impulse Response
  • the filtering means 50 can comprise an IIR filter (Infinite Impulse Response).
  • the filtering means 50 can comprise a comb filter.
  • the filtering means 50 use the partitioned convolution technique in order to ensure minimal latency time, such partitioned convolution requiring a "smooth" filtering in order to prevent artifacts.
  • the transfer function which makes it possible to modify the sound timbre of the source electric guitar 15 in order to make it identical to the sound timbre of the target electric guitar 13, is not calculated by the processing means 30 comprised in the device 10 proper, but is calculated in advance by a remote computer of the server type which is connected, for example through a telematic communications network like the internet, to the device 10 and to which the processing means 30 delegate the processing.
  • the user first selects the sound profile 43 of the target electric guitar 13, and then begins to play the source electric guitar 15 freely, or following a suggested method.
  • the device 10 for simulating a sound timbre acquires and converts the electrical signal generated by the electric guitar 15 being played and, on the basis of the sound profile 43 selected earlier, calculates a transfer function to be applied, by way of the filtering means 50, to the electrical signal of the electric guitar 15 being played, in order to optimally simulate the sound timbre of the electric guitar 13.
  • the output means 55 receive the electrical signal of the electric guitar 15 being played by the user, duly modified by the passage through the filtering means 50 on the basis of the previously-calculated transfer function, and produce a new electrical signal in output, which is sent for example to amplifiers or loudspeakers 60, such new electrical signal having the same sound timbre as the electric guitar 13.
  • the 10 is capable of defining and storing, for example, the sound profile 42 that corresponds to the electric guitar 12, is the following.
  • step 100 the user activates the learning procedure by acting on the device 10, for example by selecting such procedure by way of an adapted interface or an adapted selector comprised in the device 10.
  • the device 10 configures its components in order to learn, i.e. in order to define and store, a new sound profile 42 corresponding to the input electrical signal generated by an electric guitar
  • step 105 the user plays a note on the new electric guitar 12, which as a consequence generates a corresponding input electrical signal which arrives at the device 10 by way of the input means 20.
  • step 110 the device 10 identifies the frequency of the electrical signal that corresponds to the note that has just been played by the user on the new electric guitar 12 and, in step 115, the device 10 samples, for example according to the technique described above, the same electrical signal that corresponds to the note that has just been played by the user.
  • step 120 checks whether the identification of the spectrum has been completed or not.
  • step 105 the learning procedure returns to step 105, in which the user plays an additional note on the new electric guitar 12, as a consequence producing a corresponding electrical signal.
  • the user must play at least one note per string on the electric guitar 12 until the entire range of extension of the instrument is covered, preferably playing the same number of notes for each string.
  • the learning procedure weighs the contribution of the different strings equally for the calculation of the average frequency spectrum comprised in the sound profiles 42, 43, 44 and 45 of the electric guitars 12, 13, 14 and 15, even if the number of notes played is not the same for each string.
  • the user plays the same number of notes for each string. Therefore, in this case, the sound profiles 42, 43, 44 and 45 are defined by playing the same number of notes for each string.
  • the user plays notes that belong to a chromatic scale. Therefore, in this case, the sound profiles 42, 43, 44 and 45 are defined by playing notes that belong to a chromatic scale.
  • the user plays the same sequence of notes, typically a preset sequence, with all the different electric guitars 12, 13, 14 and 15, so that all the corresponding sound profiles 42, 43, 44 and 45 are defined on the basis of the same sequence of notes.
  • the sound profile of a source electric guitar and the sound profile of a target electric guitar will be defined on the basis of the same sequence of notes.
  • the learning procedure ends in step 125, with the storage in the memory 40 of the device 10 of the new sound profile 42 that corresponds to the new electric guitar 12, such new sound profile 42 comprising, in particular, the spectrum of the electrical signal originating from the new electric guitar 12, such spectrum identifying the sound timbre that corresponds thereto.
  • Operation of the device 10 for simulating a sound timbre, particularly for stringed electrical musical instruments, according to the invention, in particular with regard to the playing procedure, thanks to which the device 10 is capable of simulating the sound timbre corresponding, for example, to the sound profile 43 that corresponds to the (target) electric guitar 13, although the user is actually playing a different musical instrument such as for example the (source) electric guitar 15, is the following.
  • step 150 the user starts the playing procedure by selecting, by way of the selection means 35, the target electric guitar 13 whose sound timbre the user wishes to simulate, or rather by selecting the sound profile 43, present in the memory 40 of the device 10, corresponding thereto.
  • the device 10 configures its components to modify the input electrical signal generated by a source electric guitar 15.
  • step 155 the device 10 according to the invention, and in particular the processing means 30, calculate an appropriate transfer function that is adapted to modify the sound timbre of the source electric guitar 15 until it is made wholly identical to the sound timbre of the selected target electric guitar 13.
  • such transfer function can be calculated by a remote computer of the server type which is connected, for example through a telematic communications network like the internet, to the device 10 and to which the processing means 30 delegate the processing
  • a transfer function is calculated for each individual string. In another embodiment of the invention, a transfer function is calculated for a set of strings, for example if a polyphonic pickup is used.
  • step 160 the user plays some notes on the source electric guitar 15, as a consequence producing a corresponding electrical signal, and, in step 165, the device 10 acquires such input electrical signal by way of the input means 20.
  • step 170 the device 10 applies the above mentioned transfer function to this input signal, through the filtering means 50.
  • step 175 the output means 55 of the device 10 receive the electrical signal of the source electric guitar 15, duly modified by the passage through the filtering means 50 on the basis of the previously- calculated transfer function, and produce a new electrical signal as output, such new electrical signal having the same sound timbre as the target electric guitar 13.
  • step 175 the playing procedure cyclically returns to step 160, in which the user plays some notes on the source electric guitar 15, until the user interrupts such procedure, by ceasing to play the source electric guitar 15.
  • operation of the invention is based on the definition, either preset or set using the learning procedure, of at least one reference electric guitar (B), thanks to which it is possible, by playing a source electric guitar (A), to simulate the sound timbre of one of the predefined target electric guitars (C, D, E, F and G).
  • the reference electric guitar (B), or more generally the reference musical instrument comprises characteristics of the model of musical instrument and/or of the configuration of use of the musical instrument.
  • These characteristics can comprise the model of stringed musical instrument, the type and/or the position of the pickup (for example single coil pickup at the bridge), the type and/or the scaling of the strings, the position of the volume/tone potentiometer, and the playing technique (for example with a plectrum or using pizzicato).
  • the sound profiles of the target electric guitars C, D, E, F and G are preloaded in the memory 40 of the device 10 for simulating a sound timbre according to the invention and no longer comprise the spectrum, i.e. the frequency distribution, of the electrical signal originating from an electric guitar, and instead they directly comprise the spectral transfer functions for passing from the sound timbre of at least one reference guitar B to the sound timbre of a plurality of target electric guitars C, D, E, F and G (in particular a spectral transfer function for each sound profile corresponding to a target electric guitar).
  • the device 10 for simulating a sound timbre is configured to execute morphing, which consists of the fluid, gradual and continuous conversion between two or more different target sound profiles to be simulated, i.e. between two or more different sound timbres or spectra for two or more different target electric guitars.
  • the user can play the source electric guitar B and simulate a sound timbre or spectrum that during playing passes from the one that corresponds to the target electric guitar A to the one that corresponds to the target electric guitar C, by modulating the conversion coefficient x.
  • the conversion coefficient x can be modified dynamically and in real time by the user during playing, for example by way of an expression pedal connected to the device 10 according to the invention, or by way of a knob included in the device 10 according to the invention.
  • morphing is executed between two or more different target sound profiles to be simulated, i.e. between two or more different sound timbres or spectra corresponding to two or more different target electric guitars, but which were obtained at different positions of the volume potentiometer of such target electric guitar.
  • the variation of volume has the consequence of varying the sound timbre of the electrical stringed musical instrument, in particular of the electric guitar.
  • the conversion i.e. the switching between the various sound timbres corresponding to the various volume levels
  • the conversion can be executed dynamically and in real time by the user during playing, for example by way of an expression pedal connected to the device 10 according to the invention, or by way of a knob included in the device 10 according to the invention.
  • the device 10 for simulating a sound timbre is configured to create a new target sound timbre to be simulated, in response to an input action by the user which is detected by graphical interface means comprised in the device 10.
  • the user can define or "draw” a new target sound timbre to be simulated; more precisely, the user can define or “draw” a new characteristic spectrum or a new spectral transfer function to be applied, by way of the filtering means 50, to the electrical signal generated by the source electric guitar 15.
  • the new sound timbre defined or "drawn" by the user can have low tones corresponding to a Gibson Les Paul, medium tones corresponding to a Fender Stratocaster, and high tones corresponding again to a Gibson Les Paul, or spectrum portions that do not exactly correspond to any of the two spectra but which are defined freely by tracing an alternative curve to the two curves that represent the profiles of the two guitars mentioned.
  • the spectral representation of the new transfer function 220 is obtained by mutually combining the initial portion, corresponding to low tones, of the spectral transfer function 225, the central portion, corresponding to medium tones, of the spectral transfer function 230, and the end portion, corresponding to high tones, of the spectral transfer function 225; the transfer functions 225 and 230 being already known, in that they were previously calculated according to one of the methods described above, and substantially playing the role of maps or guides to assist with the definition or "drawing" of the user.
  • the learning procedure can even be carried out without directly playing the target electric guitar, or more generally the target electrical stringed musical instrument, by supplying as input to the device 10, in particular to the input means 20, an audio recording, in any format, of the target electrical stringed musical instrument for which it is desired to define and store the sound profile.
  • the learning procedure can be omitted entirely, and be substituted by the automatic loading into the memory 40 of preset sound profiles, corresponding to the most widely differing musical instruments, such as for example by loading files of sound profiles using storage devices such as USB drives or CD-ROMs.
  • the device 10 for simulating a sound timbre can be many and varied.
  • the device 10 according to the invention can be implemented inside a pedal board or a multi-effect rack for guitars (mainly for use when playing live), or within a amplifier for electrical or electrical/acoustic musical instruments, or directly on electric guitars, electric bass guitars or bowed instruments (for example a violin provided with pickups) in the electronic components integrated in the body of the musical instrument, or also by way of mobile devices, such as for example smartphones and tablet computers, provided with an adapted app and optionally connected to an external electronic card, or by way of a DAW (Digital Audio Workstation) plugin.
  • DAW Digital Audio Workstation
  • the electrical stringed musical instrument used can also comprise a hexaphonic pickup, which, in any event, is not strictly necessary for the correct operation of the device for simulating a sound timbre according to the invention.
  • the device 10 for simulating a sound timbre can also comprise accessory functionalities, such as for example the simulation of amplification combined with effects such as saturation, delay or reverb, a tuning function, pitch shift, and so on.
  • the device and the method for simulating a sound timbre make it possible to overcome the qualitative limitations of the known art, in that they make it possible to modify the sound timbre of a first, source electrical stringed musical instrument until it is made wholly identical to the sound timbre of a second, target electrical stringed musical instrument, for example any model of electric guitar, in order to simulate the musical timbre of another model of stringed musical instrument of the same type.
  • Another advantage of the device and of the method for simulating a sound timbre according to the invention consists in that they do not require a hexaphonic pickup, or even a dedicated stringed musical instrument, thus enabling the user to save the money that would be used to purchase such further component, or a new instrument, and the time necessary for assembly, and also avoid having to provide an adapted electric power supply for the electronic components inside the electrical stringed musical instrument.
  • Another advantage of the device and of the method for simulating a sound timbre according to the invention consists in that they calculate, for each pair of stringed electrical musical instruments, for example for each pair constituted by a source electric guitar and a target electric guitar, the modifications to apply to the electrical signal of the first (source) stringed musical instrument in order to obtain the same sound timbre as the second (target) stringed musical instrument.
  • the device and the method for simulating a sound timbre according to the invention enable the user to record the sound, in particular the sound timbre, of his/her own stringed musical instrument, so that, if the strings age, it will be possible to simulate the original, lively sound timbre.
  • the device and the method for simulating a sound timbre according to the invention make it possible to simulate the sound timbre of a stringed musical instrument which is obtainable using thicker strings, but playing the same stringed musical instrument with thinner strings, so as to obtain, for example, a full-bodied sound timbre while avoiding the drawbacks of using the bending technique.
  • the device and the method for simulating a sound timbre, particularly for stringed electrical musical instruments, according to the invention not only make it possible to optimally simulate the sound timbre of a target electrical stringed musical instrument, in the case where the notes are played on the source instrument and on the target instrument using the same technique (for example with a plectrum) and with the same intensity, but they also make it possible to simulate the player's technique, in the case where the notes are played using different techniques and intensities between the source instrument and the target instrument.
  • this enables the user who so wishes to play the source electrical stringed musical instrument using a plectrum, but obtaining an output sound corresponding to playing with the pizzicato technique, or to play "softly”, but obtaining the typical tone of a forceful playing technique.
  • the device and the method for simulating a sound timbre do not have any mathematical model for the identification and consequent processing of the position of the pickup of the electrical stringed musical instrument, be they of the monophonic type or of the hexaphonic type.
  • the device and the method for simulating a sound timbre according to the invention have been conceived in particular for use in combination with stringed electrical musical instruments, such as for example electric guitars or electric bass guitars, they can also be used, more generally, for simulating the sound timbre of musical instruments of many and varied types.
  • the materials used may be any according to requirements and to the state of the art.
  • the device according to the invention can also be provided by way of fixed processing devices, such as for example a personal computer, or mobile processing devices, such as for example a smartphone or a tablet computer, all of which already comprise input means, output means, memory means and a processor, implementing the filter via software.
  • fixed processing devices such as for example a personal computer
  • mobile processing devices such as for example a smartphone or a tablet computer, all of which already comprise input means, output means, memory means and a processor, implementing the filter via software.
PCT/IB2016/052098 2015-04-13 2016-04-13 Device and method for simulating a sound timbre, particularly for stringed electrical musical instruments WO2016166675A1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
EP16719524.7A EP3284083A1 (en) 2015-04-13 2016-04-13 Device and method for simulating a sound timbre, particularly for stringed electrical musical instruments
EP20169798.4A EP3739569A1 (en) 2015-04-13 2016-04-13 Device and method for simulating a sound timbre, particularly for stringed electrical musical instruments
US15/566,356 US10115381B2 (en) 2015-04-13 2016-04-13 Device and method for simulating a sound timbre, particularly for stringed electrical musical instruments
US16/173,336 US20190066644A1 (en) 2015-04-13 2018-10-29 Device and method for simulating a sound timbre, particularly for stringed electrical musical instruments

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
ITMO20150080 2015-04-13
ITMO2015A000080 2015-04-13

Related Child Applications (2)

Application Number Title Priority Date Filing Date
US15/566,356 A-371-Of-International US10115381B2 (en) 2015-04-13 2016-04-13 Device and method for simulating a sound timbre, particularly for stringed electrical musical instruments
US16/173,336 Continuation US20190066644A1 (en) 2015-04-13 2018-10-29 Device and method for simulating a sound timbre, particularly for stringed electrical musical instruments

Publications (1)

Publication Number Publication Date
WO2016166675A1 true WO2016166675A1 (en) 2016-10-20

Family

ID=53794390

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2016/052098 WO2016166675A1 (en) 2015-04-13 2016-04-13 Device and method for simulating a sound timbre, particularly for stringed electrical musical instruments

Country Status (3)

Country Link
US (2) US10115381B2 (und)
EP (2) EP3284083A1 (und)
WO (1) WO2016166675A1 (und)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110534128A (zh) * 2019-08-09 2019-12-03 普联技术有限公司 一种噪音处理方法、装置、设备及存储介质
CN111862915A (zh) * 2020-07-15 2020-10-30 孙华 一种具有人工智能算法的电子筝
JP7184218B1 (ja) 2022-03-24 2022-12-06 ヤマハ株式会社 音響機器および該音響機器のパラメータ出力方法
US11842711B1 (en) * 2022-12-02 2023-12-12 Staffpad Limited Method and system for simulating musical phrase

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016166675A1 (en) * 2015-04-13 2016-10-20 Filippo Zanetti Device and method for simulating a sound timbre, particularly for stringed electrical musical instruments
CN109473087A (zh) * 2018-12-20 2019-03-15 深圳市魔耳乐器有限公司 一种可复制音色的自学习电吉他
CN109473086A (zh) * 2018-12-20 2019-03-15 深圳市魔耳乐器有限公司 一种可复制音色的自学习效果器
CN109817193B (zh) * 2019-02-21 2022-11-22 深圳市魔耳乐器有限公司 一种基于时变多段式频谱的音色拟合系统
CN110534081B (zh) * 2019-09-05 2021-09-03 长沙市回音科技有限公司 一种将吉他声音转换成其他乐器声音的实时演奏方法及系统

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110064244A1 (en) * 2009-09-15 2011-03-17 Native Instruments Gmbh Method and Arrangement for Processing Audio Data, and a Corresponding Computer Program and a Corresponding Computer-Readable Storage Medium
EP2372692A2 (en) * 2010-03-18 2011-10-05 YAMAHA Corporation Signal processing device and stringed instrument
EP2549473A1 (en) * 2011-07-22 2013-01-23 Mikko Pekka Vainiala Method of sound analysis and associated sound synthesis

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0594191A (ja) * 1991-10-01 1993-04-16 Roland Corp 電気弦楽器用ピツクアツプの周波数特性補償装置
JP3261878B2 (ja) * 1994-08-10 2002-03-04 ヤマハ株式会社 音響信号発生装置
US6448488B1 (en) * 1999-01-15 2002-09-10 Fishman Transducers, Inc. Measurement and processing of stringed acoustic instrument signals
US7279631B2 (en) * 2002-07-16 2007-10-09 Line 6, Inc. Stringed instrument with embedded DSP modeling for modeling acoustic stringed instruments
US7799986B2 (en) * 2002-07-16 2010-09-21 Line 6, Inc. Stringed instrument for connection to a computer to implement DSP modeling
US6787690B1 (en) * 2002-07-16 2004-09-07 Line 6 Stringed instrument with embedded DSP modeling
US8842847B2 (en) * 2005-01-06 2014-09-23 Harman International Industries, Incorporated System for simulating sound engineering effects
US20070168063A1 (en) * 2006-01-18 2007-07-19 Gallien Robert A Programmable tone control filters for electric guitar
JP5151483B2 (ja) * 2008-01-07 2013-02-27 ヤマハ株式会社 係数測定装置、効果付与装置、および楽音発生装置
US9196235B2 (en) * 2010-07-28 2015-11-24 Ernie Ball, Inc. Musical instrument switching system
US9099069B2 (en) * 2011-12-09 2015-08-04 Yamaha Corporation Signal processing device
US9099066B2 (en) * 2013-03-14 2015-08-04 Stephen Welch Musical instrument pickup signal processor
US9280964B2 (en) * 2013-03-14 2016-03-08 Fishman Transducers, Inc. Device and method for processing signals associated with sound
WO2016166675A1 (en) * 2015-04-13 2016-10-20 Filippo Zanetti Device and method for simulating a sound timbre, particularly for stringed electrical musical instruments
SE544164C2 (en) * 2015-06-22 2022-02-15 Modern Ancient Instr Networked Ab Method to control the timbre of a target stringed instrument in real-time
US9626949B2 (en) * 2015-07-21 2017-04-18 Positive Grid LLC System of modeling characteristics of a musical instrument

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110064244A1 (en) * 2009-09-15 2011-03-17 Native Instruments Gmbh Method and Arrangement for Processing Audio Data, and a Corresponding Computer Program and a Corresponding Computer-Readable Storage Medium
EP2372692A2 (en) * 2010-03-18 2011-10-05 YAMAHA Corporation Signal processing device and stringed instrument
EP2549473A1 (en) * 2011-07-22 2013-01-23 Mikko Pekka Vainiala Method of sound analysis and associated sound synthesis

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110534128A (zh) * 2019-08-09 2019-12-03 普联技术有限公司 一种噪音处理方法、装置、设备及存储介质
CN111862915A (zh) * 2020-07-15 2020-10-30 孙华 一种具有人工智能算法的电子筝
CN111862915B (zh) * 2020-07-15 2024-03-22 孙华 一种具有人工智能算法的电子筝
JP7184218B1 (ja) 2022-03-24 2022-12-06 ヤマハ株式会社 音響機器および該音響機器のパラメータ出力方法
JP2023141541A (ja) * 2022-03-24 2023-10-05 ヤマハ株式会社 音響機器および該音響機器のパラメータ出力方法
US11842711B1 (en) * 2022-12-02 2023-12-12 Staffpad Limited Method and system for simulating musical phrase

Also Published As

Publication number Publication date
EP3739569A1 (en) 2020-11-18
US10115381B2 (en) 2018-10-30
EP3284083A1 (en) 2018-02-21
US20180122347A1 (en) 2018-05-03
US20190066644A1 (en) 2019-02-28

Similar Documents

Publication Publication Date Title
US10115381B2 (en) Device and method for simulating a sound timbre, particularly for stringed electrical musical instruments
Välimäki et al. Physical modeling of plucked string instruments with application to real-time sound synthesis
US7799986B2 (en) Stringed instrument for connection to a computer to implement DSP modeling
US8716586B2 (en) Process and device for synthesis of an audio signal according to the playing of an instrumentalist that is carried out on a vibrating body
CN105917403B (zh) 在电子拾音器中使用低电感线圈的方法和装置
Klapuri et al. Robust multipitch estimation for the analysis and manipulation of polyphonic musical signals
US9515630B2 (en) Musical dynamics alteration of sounds
Penttinen et al. Model-based sound synthesis of the guqin
CN111739495A (zh) 伴奏控制装置、电子乐器、控制方法以及记录介质
Gabrielli et al. A digital waveguide-based approach for Clavinet modeling and synthesis
JP6657713B2 (ja) 音響処理装置および音響処理方法
US8750530B2 (en) Method and arrangement for processing audio data, and a corresponding corresponding computer-readable storage medium
US10319353B2 (en) Method for audio sample playback using mapped impulse responses
JP2022550746A (ja) 音響空間のモード残響効果
Stöter et al. Unison Source Separation.
Pedroza et al. Egfxset: Electric guitar tones processed through real effects of distortion, modulation, delay and reverb
Trail et al. Direct and surrogate sensing for the Gyil african xylophone.
Freire et al. Real-Time Symbolic Transcription and Interactive Transformation Using a Hexaphonic Nylon-String Guitar
JP3404850B2 (ja) 音源装置
Tolonen Object-based sound source modeling for musical signals
Jensen Musical instruments parametric evolution
JP3526505B2 (ja) 電子楽器
SE2051550A1 (en) Method and system for recognising patterns in sound
Penttinen et al. Physical modeling of the guqin‑a Chinese string instrument
Järveläinen Piirteiden havaitseminen näpätyissä kielisoitinäänissä

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16719524

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 15566356

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE