KR102018376B1 - Mobile terminal - Google Patents
Mobile terminal Download PDF
KR102018376B1 KR1020130084290A KR20130084290A KR102018376B1 KR 102018376 B1 KR102018376 B1 KR 102018376B1 KR 1020130084290 A KR1020130084290 A KR 1020130084290A KR 20130084290 A KR20130084290 A KR 20130084290A KR 102018376 B1 KR102018376 B1 KR 102018376B1
receiving device
preliminary message
KR1020130084290A
권윤미
권아림
박지영
장형태
정혜미
엘지전자 주식회사
2013-07-17 Application filed by 엘지전자 주식회사 filed Critical 엘지전자 주식회사
2013-07-17 Priority to KR1020130084290A priority Critical patent/KR102018376B1/en
238000004891 communication Methods 0 claims description 25
238000004458 analytical methods Methods 0 claims description 7
230000036410 touch Effects 0 description 77
230000000694 effects Effects 0 description 10
238000010295 mobile communication Methods 0 description 7
230000000638 stimulation Effects 0 description 5
238000003909 pattern recognition Methods 0 description 1
230000013707 sensory perception of sound Effects 0 description 1
230000015541 sensory perception of touch Effects 0 description 1
H04M1/64—Automatic arrangements for answering calls; Automatic arrangements for recording messages for absent subscribers; Arrangements for recording conversations
H04M1/72—Substation extension arrangements; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selecting
H04M1/725—Cordless telephones
H04M1/72519—Portable communication terminals with improved user interface to control a main telephone operation mode or to indicate the communication status
H04M1/72522—With means for supporting locally a plurality of applications to increase the functionality
H04M1/72547—With means for supporting locally a plurality of applications to increase the functionality with interactive input/output means for internally managing multimedia messages
H04M1/57—Arrangements for indicating or recording the number of the calling subscriber at the called subscriber's set
H04M1/575—Means for retrieving and displaying personal data about calling party
The mobile terminal according to the present invention may generate a preliminary message based on the information obtained through the information acquiring means before the call connection with the call receiving device and transmit the preliminary message to the call receiving device.
The present invention relates to a mobile terminal, and more particularly, to a mobile terminal capable of generating a preliminary message using a voice or image of a user acquired before a call connection and transmitting the preliminary message to a call receiving terminal.
As terminals, such as personal computers, laptops, mobile phones, and smartphones, are diversified in function, multimedia devices with complex functions such as taking pictures or videos, playing music or video files, and receiving games and broadcasts It is implemented in the form of (multimedia player).
In order to support and increase the function of the terminal, it may be considered to improve the structural part and / or the software part of the terminal. Recently, as the various terminals including the mobile terminal provide complex and various functions, the menu structure is also complicated.
On the other hand, such a mobile terminal is equipped with a wireless call function, the call originating terminal is not able to perform data communication with the call receiving device until the phone application is executed in the mobile terminal is connected to the call.
The technical problem to be solved by the present invention is to provide a mobile terminal that can generate a preliminary message by using the user's voice or image obtained before the call connection after the call is sent and transmit the generated preliminary message to the call receiving terminal before the call connection. It is.
Another technical problem to be solved by the present invention is to provide a mobile terminal capable of transmitting a preliminary message generated and transmitted before a call connection after call origination using a data section allocated to a standby session.
Another technical problem to be solved by the present invention is to generate a preliminary message before the call connection and transmit to the call receiving device, the time interval and the preliminary message to obtain the information to generate a preliminary message reflecting the operation state of the call receiving device The present invention provides a mobile terminal capable of differently setting a method of transmitting a call to a call receiving device.
Another technical problem to be solved by the present invention is to provide a mobile terminal capable of providing a user interface for generating a preliminary message to be transmitted in advance to a call receiving device before a call connection.
Technical problems to be achieved by the present invention are not limited to the above-mentioned technical problems, and other technical problems not mentioned above will be clearly understood by those skilled in the art from the following description. Could be.
According to an aspect of the present invention, there is provided a mobile terminal, the wireless communication module performing a communication function with an external device; Information obtaining means; And a controller.
When the call origination request is received, the control unit generates a call reception request message and transmits the call reception request message to the call reception device, and after receiving the call origination request, the controller receives information obtained through the information acquisition means before the call connection with the call reception device. Based on the preliminary message (preliminary message) can be generated and sent to the call receiving device.
The control unit may be configured to generate the preliminary message by using a data interval allocated to an early media session, which is formed after the call reception request message is transmitted and before the call connection is made with the call receiving device. Can be sent to.
The preliminary message may include at least one of a voice message and a text generated based on the voice of the user acquired by the information acquiring means and an image of the user photographed by the information acquiring means.
The mobile terminal may further include a display unit. In this case, when the call is not connected with the call receiving device and the call origination procedure is terminated, the controller displays the user interface for selecting an application for transmitting the preliminary message to the call receiving device. We can display in wealth.
The user interface may include a list of applications executed upon selection. In this case, the controller may change the type of application included in the user interface according to the call receiving device.
The controller may automatically transmit the preliminary message to the call receiving device by using a predetermined application when a call origination procedure is terminated without a call to the call receiving device connected.
The controller may start acquiring information for generating the preliminary message when at least one of the voice of the user is recognized, the specific word is recognized through the user's voice, and the user's specific manipulation through the input means. have.
The controller may generate the generated spare message to have a smaller capacity than the data interval allocated to the standby session when the capacity of the generated spare message is greater than the capacity of the data interval allocated to the standby session. The preliminary message may be processed and transmitted to the call receiving terminal.
The controller may generate a preliminary message including text generated based on the voice of the user and transmit the preliminary message to the call receiving device. In this case, the size of the text may vary according to the size of the voice of the user.
The controller may generate a preliminary message including an image corresponding to a result of analyzing the voice of the user among texts generated based on the voice of the user and a plurality of images stored in a memory, and transmit the preliminary message to the call receiving device. .
The controller may control the preliminary message to be included in a call history of the call receiving device.
According to another aspect of the present invention, there is provided a mobile terminal including a wireless communication module for performing a communication function with an external device; Information obtaining means; And a controller.
When the call origination request is received, the controller generates a call reception request message and transmits the call reception request message to the call reception device, and determines an operation state of the call reception device based on a response message received in response to the call reception request message. After the call origination request is received, a preliminary message may be generated based on the information obtained through the information obtaining means. And the control unit reflects an operation state of the determined call receiving device, and includes a time interval for acquiring information through the information obtaining means and transmitting the preliminary message to the call receiving device in order to generate the preliminary message. Can be set differently.
If the call receiving device is in a callable state, the controller may generate a preliminary message based on the information obtained through the information acquiring means after the call origination request is received and before the standby session is formed. The controller 180 transmits the generated preliminary message to the call receiving device using a data interval allocated to a standby session after the call reception request message is transmitted and before being connected to the call receiving device. Can be.
When the call receiving device is in a call, the controller may generate a preliminary message based on the information obtained through the information obtaining means after the call origination request is received and before the standby session is formed. The controller 180 may transmit the generated preliminary message to the call receiving device using a data section allocated to the standby session.
When the call receiving device is busy, the controller may generate a preliminary message based on the information obtained through the information acquiring means after the call origination request is received and before the call origination procedure is terminated. The controller may display a user interface for selecting an application for transmitting the preliminary message to the call receiving device.
If the call receiving device is turned off, the controller may generate a preliminary message based on the information obtained through the information acquiring means after the call origination request is received and before the standby session is formed. The controller may transmit the generated preliminary message to the call receiving device using a data section allocated to the standby session.
When the call receiving device is powered off, the controller may generate a preliminary message based on the information obtained through the information acquiring means after the call origination request is received and before the call origination procedure is terminated. The controller may display a user interface for selecting an application for transmitting the preliminary message to the call receiving device.
Here, the user interface may include a list of applications to be executed when selected, and the controller may change the type of applications included in the user interface according to the call receiving device.
The mobile terminal according to another embodiment of the present invention for solving the technical problem is a display unit; A wireless communication module performing a communication function with an external device; And a controller. The control unit displays a user interface for generating a preliminary message to be transmitted in advance to the call receiving terminal before the call connection with the call receiving device, and displays the preliminary message generated through the user interface. The call interval may be transmitted to the call receiving device by using a data interval allocated to an early media session which is established before the call is connected.
The mobile terminal may further include a storage unit, and the user interface may provide a function of creating a new preliminary message or editing or selecting a preliminary message previously stored in the storage unit. The control unit may display the user interface on the display unit before receiving a call origination request, store a preliminary message generated through the user interface in the storage unit, and if the call origination request is received, the standby session. The preliminary message stored in the memory may be transmitted to the call receiving device using the data interval allocated to the call reception device.
The controller may display the user interface on the display unit after receiving a call origination request.
A user of a mobile terminal according to the present invention. After the call is sent, a preliminary message may be generated using a user's voice or image acquired before the call is connected, and the generated preliminary message may be transmitted to the call receiving terminal before the call is connected.
In addition, the present invention provides a mobile terminal capable of transmitting a preliminary message generated and transmitted before a call connection after a call origination using a data section allocated to an early media session, which is a non-billing area.
A user of a mobile terminal according to the present invention. Before the call connection, the preliminary message may be transmitted in various ways by reflecting the operation state of the call receiving device.
1 is a block diagram of a mobile terminal according to an embodiment of the present invention.
2 is a flowchart illustrating an example of a method for driving a mobile terminal according to the present invention.
3 is a flowchart illustrating another example of a method for driving a mobile terminal according to the present invention.
4 illustrates an example in which a preliminary message is generated and transmitted according to the mobile terminal driving method illustrated in FIG. 3.
FIG. 5 shows another example in which a preliminary message is generated and transmitted according to the method for driving a mobile terminal shown in FIG. 3.
6 illustrates another example in which a preliminary message is generated and transmitted according to the method of driving a mobile terminal shown in FIG. 3.
FIG. 7 illustrates another example in which a preliminary message is generated and transmitted according to the mobile terminal driving method shown in FIG. 3.
FIG. 9 is a conceptual diagram illustrating a standby session in which a preliminary message is transmitted in the mobile terminal composition method of FIG. 3.
10 is a flowchart illustrating still another example of a method for driving a mobile terminal according to the present invention for processing a preliminary message in consideration of a capacity allocated to a standby session.
FIG. 11 illustrates an example of reducing a capacity of a preliminary message in a mobile terminal according to the mobile terminal driving method of FIG. 10.
12 is a flowchart illustrating still another example of a method for driving a mobile terminal according to the present invention.
13 and 14 illustrate an example of a process in which a preliminary message is transmitted to a call receiving terminal when a call fails according to the mobile terminal driving method illustrated in FIG. 12.
FIG. 15 shows that in the mobile terminal 100 according to the present invention, a user interface for separately transmitting a preliminary message at the end of a call after performing a call is provided.
16 illustrates that even when a call is terminated after a call connection, the mobile terminal according to the present invention provides a user interface for transmitting a preliminary message.
17 and 18 illustrate an example in which a preliminary message transmitted from a mobile terminal according to the present invention is provided as a call history of a call receiving device.
19 to 23 illustrate examples of generating a preliminary message based on a voice of a user in a mobile terminal according to the present invention.
FIG. 25 is a flowchart illustrating an example of a method of driving a mobile terminal shown in FIG. 14.
FIG. 26 is a flowchart illustrating another example of a method for driving a mobile terminal shown in FIG. 24.
FIG. 27 illustrates examples in which a preliminary message is generated and transmitted when a call is possible with a call receiving device according to the method of driving a mobile terminal shown in FIG. 24.
FIG. 28 illustrates an example in which a preliminary message is generated and transmitted when the call receiving device is busy or the call receiving device is powered off according to the method of driving the mobile terminal shown in FIG. 24.
29 illustrates an example in which a preliminary message generated by the mobile terminal 100 according to the present invention is displayed on the mobile terminal 100 in the form of a speech bubble.
30 shows an example in which a part of a preliminary message displayed divided into a plurality of parts is selected and transmitted in a mobile terminal according to the present invention.
31 illustrates an example in which a preliminary message displayed divided into a plurality of parts is merged in the mobile terminal 100 according to the present invention.
33 illustrates an example in which a preliminary message is generated according to the mobile terminal driving method illustrated in FIG. 32.
34 to 35 illustrate another example in which a preliminary message is generated according to the mobile terminal driving method illustrated in FIG. 32.
FIG. 36 illustrates another example in which a preliminary message is generated according to the mobile terminal driving method illustrated in FIG. 32.
37 shows an example in which a call receiving terminal transmits a response message to a preliminary message received from a call originating terminal.
38 illustrates an example in which information corresponding to the analysis result of the preliminary message is transmitted to the call originating terminal together with the preliminary message in the mobile terminal according to the present invention.
39 shows that a preliminary message transmitted from a mobile terminal according to the present invention is output as a voice message from a call receiving terminal.
The above objects, features and advantages of the present invention will become more apparent from the following detailed description taken in conjunction with the accompanying drawings. Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. Like numbers refer to like elements throughout. In addition, when it is determined that the detailed description of the known function or configuration related to the present invention may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be omitted.
Hereinafter, a mobile terminal related to the present invention will be described in more detail with reference to the accompanying drawings. The suffixes "module" and "unit" for components used in the following description are given or used in consideration of ease of specification, and do not have distinct meanings or roles from each other.
The mobile terminal described herein may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), navigation, a dedicated terminal, and the like. have. However, the scope of the present invention is not limited thereto.
1 is a block diagram of a mobile terminal 100 according to an embodiment of the present invention. Referring to FIG. 1, the mobile terminal 100 includes a wireless communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, The storage unit 160, the interface unit 170, the controller 180, and the power supply unit 190 may be included. The components shown in FIG. 1 are not essential, so the mobile terminal 100 may have more or fewer components.
Hereinafter, the components will be described in order.
The wireless communication unit 110 may include one or more modules that enable wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and a network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless internet module 113, a short range communication module 114, a location information module 115, and the like. .
The broadcast receiving module 111 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel.
The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may mean a server that generates and transmits a broadcast signal and / or broadcast related information or a server that receives a previously generated broadcast signal and / or broadcast related information and transmits the same to a terminal. The broadcast signal may include not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a broadcast signal having a data broadcast signal combined with a TV broadcast signal or a radio broadcast signal.
The broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.
The broadcast related information may exist in various forms. For example, it may exist in the form of Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).
The broadcast receiving module 111 receives broadcast signals using various broadcasting systems, and in particular, digital multimedia broadcasting-terrestrial (DMB-T), digital multimedia broadcasting-satellite (DMB-S), and media forward link (MediaFLO). Digital broadcast signals can be received using digital broadcasting systems such as only), digital video broadcast-handheld (DVB-H), integrated services digital broadcast-terrestrial (ISDB-T), and the like. Of course, the broadcast receiving module 111 may be configured to be suitable for not only the above-described digital broadcast system but also other broadcast system for providing a broadcast signal.
The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the storage 160.
The mobile communication module 112 transmits and receives a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call call signal, or a text / multimedia message.
The wireless internet module 113 refers to a module for wireless internet access, and the wireless internet module 113 may be internal or external to the mobile terminal 100. Wireless Internet technologies include Wireless LAN (Wi-Fi), Wireless Broadband (Wibro), World Interoperability for Microwave Access (Wimax), High Speed Downlink Packet Access (HSDPA), and Long Term Evolution (LTE). Can be.
The short range communication module 114 refers to a module for short range communication. As a short range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like may be used.
The location information module 115 is a module for checking or obtaining the location of the mobile terminal. The location information module 115 may obtain location information using a global navigation satellite system (GNSS). Here, global satellite navigation system (GNSS) is a term used to describe radionavigation satellite systems that revolve around the earth and send reference signals from which certain types of radio navigation receivers can determine their location near or on the earth's surface. . The Global Satellite Navigation System (GNSS) includes Global Position System (GPS) operated in the United States, Galileo operated in Europe, Global Orbiting Navigational Satelite System operated in Russia, COMPASS operated in China and Japan. QZSS (Quasi-Zenith Satellite System) operated by.
As a representative example of the GNSS, the location information module 115 may be a global position system (GPS) module. The GPS module calculates information about a distance at which a point (object) is separated from three or more satellites, information about a time at which the distance information is measured, and then applies a triangulation method to the calculated distance information. Three-dimensional position information according to latitude, longitude, and altitude of one point (object) can be calculated. Furthermore, a method of calculating position and time information using three satellites and correcting the error of the calculated position and time information using another satellite is also used. The GPS module continuously calculates the current position in real time and uses the same to calculate speed information.
Referring to FIG. 1, the A / V input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video call mode or the photographing mode. The processed image frame may be displayed on the display unit 151.
The image frame processed by the camera 121 may be stored in the storage 160 or transmitted to the outside through the wireless communication unit 110. Two or more cameras 121 may be provided according to the configuration aspect of the terminal.
The microphone 122 receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, etc., and processes the external sound signal into electrical voice data. The processed voice data may be converted into a form transmittable to the mobile communication base station through the mobile communication module 112 and output in the call mode. The microphone 122 may implement various noise removing algorithms for removing noise generated in the process of receiving an external sound signal.
The user input unit 130 generates input data for the user to control the operation of the terminal. The user input unit 130 may include a key pad dome switch, a touch pad (static pressure / capacitance), a jog wheel, a jog switch, and the like.
As shown in FIG. 1, the A / V input unit 120 and the user input unit 130 may be implemented as one input unit 116. Various input data generated by the input unit 116 is related to the memo performed by the mobile terminal 100 according to the present invention, such as a memo writing function, a memo storing function, a memo inserting function, etc. through the display unit 151 implemented as a touch screen It can be used to activate or deactivate the function. The input data may include an image received through the camera 121, a voice of a user received through the microphone 122, a touch received through the display unit 151, and the like. However, the scope of the present invention is not limited thereto.
The sensing unit 140 moves such as an open / closed state of the mobile terminal 100, a location of the mobile terminal 100, presence or absence of a user contact, a user's touch operation on a specific portion, orientation of the mobile terminal, and acceleration / deceleration of the mobile terminal. By detecting the current state of the terminal 100 generates a sensing signal for controlling the operation of the mobile terminal 100. The sensing signal may be transmitted to the controller 180, and may be the basis on which the controller 180 performs a specific function.
The sensing unit 140 may include a touch sensor for detecting a touch of a user, a vibration sensor for detecting vibration generated based on the touch of the user, and a gyro for detecting rotation of the mobile terminal 100. Sensors, acceleration sensors, geomagnetic sensors, and the like. However, the scope of the present invention is not limited thereto.
In addition, as illustrated in FIG. 1, the sensing unit 140 may include a posture detection sensor including at least one of the above-described various types of sensors. Here, the posture may refer to the posture of the user as well as the posture of the mobile terminal 100.
For example, when the mobile terminal 100 is in the form of a slide phone, it may sense whether the slide phone is opened or closed. In addition, the sensor 190 may be responsible for sensing functions related to whether the power supply unit 190 supplies power or whether the interface unit 170 is coupled to an external device. Meanwhile, the sensing unit 140 may include a proximity sensor.
The output unit 150 is used to generate an output related to sight, hearing, or tactile sense, and may include a display unit 151, an audio output unit 152, an alarm unit 153, and a haptic module 154. have.
The display unit 151 displays and outputs information processed by the mobile terminal 100. For example, when the mobile terminal is in a call mode, the mobile terminal displays a user interface (UI) or a graphic user interface (GUI) related to the call. When the mobile terminal 100 is in a video call mode or a photographing mode, the mobile terminal 100 displays photographed and / or received images, a UI, and a GUI.
The display unit 151 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, or a three-dimensional display. 3D display).
Some of these displays can be configured to be transparent or light transmissive so that they can be seen from the outside. This may be referred to as a transparent display. A representative example of the transparent display is a transparent LCD. The rear structure of the display unit 151 may also be configured as a light transmissive structure. With this structure, the user can see the object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.
According to an implementation form of the mobile terminal 100, two or more display units 151 may exist. For example, a plurality of display units may be spaced apart or integrally disposed on one surface of the mobile terminal 100, or may be disposed on different surfaces, respectively.
When the display unit 151 and a sensor for detecting a touch operation (hereinafter, referred to as a touch sensor) form a mutual layer structure (hereinafter referred to as a touch screen), the display unit 151 may be configured in addition to an output device. Can also be used as an input device. The touch sensor may have, for example, a form of a touch film, a touch sheet, a touch pad, or the like.
The touch sensor may be configured to convert a change in pressure applied to a specific portion of the display unit 151 or capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor may be configured to detect not only the position and area of the touch but also the pressure at the touch.
If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and then transmits the corresponding data to the controller 180. As a result, the controller 180 can know which area of the display unit 151 is touched.
The proximity sensor may be disposed in an inner region of the mobile terminal covered by the touch screen or near the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object present in the vicinity without using a mechanical contact by using an electromagnetic force or infrared rays. Proximity sensors have a longer life and higher utilization than touch sensors.
Examples of the proximity sensor include a transmission photoelectric sensor, a direct reflection photoelectric sensor, a mirror reflection photoelectric sensor, a high frequency oscillation proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor.
When the touch screen is capacitive, the touch screen is configured to detect proximity of the cursor by a change in an electric field according to the proximity of the cursor. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.
The proximity sensor detects a proximity touch and a proximity touch pattern (eg, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, and a proximity touch movement state). Information corresponding to the sensed proximity touch operation and proximity touch pattern may be output on the touch screen.
The sound output unit 152 may output audio data received from the wireless communication unit 110 or stored in the storage unit 160 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. The sound output unit 152 outputs a sound signal related to a function (for example, a call signal reception sound and a message reception sound) performed in the mobile terminal 100. The sound output unit 152 may include a receiver, a speaker, a buzzer, and the like. In addition, the sound output unit 152 may output sound through the earphone jack 116. The user can hear the sound output by connecting the earphone to the earphone jack 116.
The alarm unit 153 may output a signal for notifying occurrence of an event of the mobile terminal 100. Examples of events occurring in the mobile terminal include call signal reception, message reception, key signal input, and touch input. The alarm unit 153 may output a signal for notifying occurrence of an event in a form other than a video signal or an audio signal, for example, vibration. The video signal or the audio signal may also be output through the display unit 151 or the sound output unit 152.
The haptic module 154 generates various tactile effects that a user can feel. Vibration is a representative example of the haptic effect generated by the haptic module 154. The intensity and pattern of vibration generated by the haptic module 154 can be controlled. For example, different vibrations may be synthesized and output or may be sequentially output.
In addition to the vibration, the haptic module 154 may be used for the effects of stimulation by the arrangement of pins vertically moving with respect to the contact skin surface, the effect of the injection force of the air through the injection or inlet or the stimulation through the suction force, and the stimulation that rubs the skin surface. Various tactile effects may be generated, such as effects by stimulation through contact of electrodes, effects by stimulation using electrostatic force, and effects of reproducing a sense of warmth and heat using an endothermic or heat generating element.
The haptic module 154 may not only deliver the haptic effect through direct contact, but also implement the haptic effect through the muscle sense of the user's finger or arm. Two or more haptic modules 154 may be provided according to a configuration aspect of the mobile terminal 100.
The storage unit 160 may store a program for the operation of the controller 180 and may temporarily store input / output data (for example, a phone book, a message, a still image, a video, etc.). The storage unit 160 may store data regarding vibration and sound of various patterns output when a touch input on the touch screen is performed.
The storage unit 160 may include a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (eg, SD or XD memory), Random Access Memory (RAM), Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM) Magnetic Memory, Magnetic It may include a storage medium of at least one type of disk, optical disk. The mobile terminal 100 may operate in connection with a web storage that performs a storage function of the storage unit 160 on the Internet.
The interface unit 170 serves as a path with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device or receives power and transmits the data to each component inside the mobile terminal 100 or transmits the data inside the mobile terminal 100 to an external device.
For example, wired / wireless headset ports, external charger ports, wired / wireless data ports, memory card ports, ports for connecting devices with identification modules, audio input / output (I / O) ports, The video input / output (I / O) port, the earphone port, and the like may be included in the interface unit 170.
The interface unit 170 may include a card slot in which the user identification module of the card type may be mounted. Then, the user identification module may be connected to the mobile terminal 100 through the card slot. In this case, a plurality of user identification modules may be connected to the interface unit 170.
The interface unit 170 may be a passage through which power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle, or various commands input from the cradle by a user. The signal may be a passage for transmitting to the mobile terminal. Various command signals or power input from the cradle may be operated as signals for recognizing that the mobile terminal is correctly mounted on the cradle.
The controller 180 typically controls the overall operation of the mobile terminal. For example, perform related control and processing for voice calls, data communications, video calls, and the like. The controller 180 may include a multimedia module 181 for playing multimedia. The multimedia module 181 may be implemented in the controller 180 or may be implemented separately from the controller 180.
The controller 180 may perform a pattern recognition process for recognizing a writing input or a drawing input performed on the touch screen as text and an image, respectively.
The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 to supply power for operation of each component.
Various embodiments described herein may be implemented in a recording medium readable by a computer or similar device using, for example, software, hardware or a combination thereof.
According to a hardware implementation, the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), and the like. It may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing the functions. It may be implemented by the controller 180.
In a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that allow at least one function or operation to be performed. The software code may be implemented by a software application written in a suitable programming language. In addition, the software code may be stored in the storage 160 and executed by the controller 180.
In the above, the configuration of the mobile terminal 100 according to the present invention has been described with reference to FIG. 1. Hereinafter, the preliminary message generation and transmission function of the mobile terminal 100 according to the present invention will be described in more detail with reference to FIGS. 2 to 39.
2 is a flowchart illustrating an example of a method for driving a mobile terminal according to the present invention. Hereinafter, a method of driving the mobile terminal will be described with reference to necessary drawings.
When a call origination request generated based on a user's input device manipulation is received, the controller 180 generates a call reception message and transmits the call reception message to a terminal of a call reception counterpart, that is, a call reception device (S100).
Then, the controller 180 obtains information by using information obtaining means before the call connection with the call receiving device, and generates a preliminary message based on the obtained information (S110).
Here, the call may include a general voice call and a video call. The information acquisition means may include a camera 121 for acquiring an external image, a microphone 122 for acquiring an audio signal, a keypad or a touch screen for generating information based on a user's manipulation. However, the scope of the present invention is not limited thereto.
In addition, in the present specification, the preliminary message refers to a message for the call caller to preliminarily transmit simple data to the call receiving device before the call is connected to the call receiving device and the real-time audio or video data transmission and reception are performed. it means. The preliminary message includes at least one of a voice message generated based on the voice of the user acquired through the microphone 122, a text message generated based on the voice of the user, and an image of the user acquired by the camera 121. can do.
When the preliminary message is generated, the controller 180 can transmit the generated preliminary message to the call receiving device through the wireless communication unit 110 (S120). Meanwhile, the preliminary message may be transmitted using an early media session allocated before the call connection with the call receiving device, may be transmitted during a call, or may be transmitted through an independent procedure after the call ends. The standby session will be described in more detail with reference to FIG. 9.
That is, according to the method of driving the mobile terminal, the call originator may deliver a predetermined message to the call receiver even before the call is connected, and the call receiver may check the message and acquire information included therein.
3 is a flowchart illustrating another example of a method for driving a mobile terminal according to the present invention. Hereinafter, a method of driving the mobile terminal will be described with reference to necessary drawings.
When the call origination request is received, the controller 180 generates a call reception message and transmits it to the call receiving terminal (S200). Thereafter, when the user's voice is recognized through the user's microphone 122, the controller 180 generates a preliminary message based on the user's voice obtained through the microphone 122 (S210).
In operation S220, the generated preliminary message is transmitted to the call receiving device by using a data interval allocated to a standby session, which is a non-billing region before call connection. Then, the user of the call receiving device may receive a message generated by the user of the call originating terminal even before the call is connected.
4 (a) shows that after the call reception request message is sent, if the user's voice is recognized, preliminary message generation is started based on the recognized user's voice. The generation of the preliminary message may be terminated when the user's voice input is completed by recognizing a time difference between words of the user's note obtained through the microphone 122.
FIG. 4B shows that a voice message "Receive Quickly" is generated based on the user's voice, and shows that the user interface 151A for transmitting it to the call receiving device is displayed on the touch screen 151. As shown in FIG. 4B, when the user touches the send button "Send" in the user interface 151A, the message may be transmitted to the call receiving device. When the user touches a cancel button "Cancel" in the user interface 151A, the transmission of the preliminary message may be cancelled.
The shaded cross shape shown in FIG. 4B may indicate that a user's touch is received. This may also be the case in other embodiments.
On the other hand, unlike shown in Figure 4, the controller 180 may transmit a preliminary message generated immediately to the call receiving terminal without going through the process of providing the user interface (151A).
5 (a) shows that the automatic transmission mode is executed when a preliminary message is generated. Referring to FIG. 5A, it can be seen that the touch screen 151 is provided with a user interface 151B indicating that a preliminary message is to be automatically transmitted after 1 second.
Meanwhile, as illustrated in FIG. 5, the controller 180 may notify the user that a preliminary message will be automatically transmitted by outputting a warning sound every 3 seconds for 1 second during the automatic transmission mode. At this time, the user may touch the cancel button "Cancel" to cancel the transmission of the preliminary message.
FIG. 5B shows that a preliminary message including generated text 151A 'and an image 151C of the call originator is displayed on the touch screen 151' of the call receiving terminal.
Meanwhile, unlike FIG. 5, the controller 180 may automatically transmit a preliminary message generated to the call receiving terminal without passing through the user interface 151B or generating a warning sound.
FIG. 6 (a) shows that when a user named "Sandy", which is the name of a call recipient stored in the address book, is called by the user, preliminary message generation is started based on the voice of the user recognized through the microphone 122. FIG. Indicates. 6B illustrates that the user interface 151A is provided on the touch screen 151 to select whether to transmit the generated preliminary message.
Meanwhile, in FIG. 6, the call receiver's name is recognized from the user's voice. For example, the mobile terminal 100 according to the present invention provides a preliminary message even when a specific word is recognized from the voice of the user. Information acquisition for generation can be initiated.
FIG. 7A illustrates that when a specific button operation by a user is recognized, preliminary message generation is started based on a voice of the user recognized through the microphone 122. 7B illustrates that the user interface 151A is provided on the touch screen 151 to select whether to transmit the generated preliminary message.
On the other hand, in Figure 7 is a case where a specific button operation is recognized, when the acquisition of information for creating a preliminary message is started as an example, even if a combination of simultaneous or sequential button operations, virtual keypad operation, etc. is generated Information acquisition for may be started.
8 (a) shows that a preliminary message is generated based on the image of the user acquired through the camera 121 together with the user's voice recognized through the microphone 122.
8 (b) shows that the preliminary message received from the call originating terminal is displayed to the terminal of the call reception counterpart before the call is connected. Referring to FIG. 8B, it can be seen that the preliminary message includes a text message 151A 'generated based on the voice of the call originator and an image 151E of the call originator.
First, in response to a call origination request of a call originator, the controller 180 transmits a call reception request message INVITE to a call reception terminal. Then, a standby session 200 is formed between the call originating terminal and the call receiving terminal. Then, a call is connected between the call originating terminal and the call receiving terminal. It is the billing area before the call connection, and it is the billing area after the call connection.
According to the method of driving the mobile terminal illustrated in FIG. 3, the mobile terminal 100 transmits a preliminary message using a data section allocated to a standby session, so that the preliminary message is transmitted to the call receiving terminal at no additional charge. Can be.
On the other hand, the data capacity allocated to such a standby session is usually 500 to 900 kilobytes of information. Therefore, the capacity of the spare message transmitted using the standby session is also limited. That is, there is no problem if the capacity of the spare message is smaller than the capacity allocated to the standby session. Otherwise, the mobile terminal 100 according to the present invention may reduce the capacity of the spare message by performing an additional data processing procedure for reducing the capacity of the spare message, and then transmit it to the call receiving terminal through a standby session. have.
10 is a flowchart illustrating still another example of a method for driving a mobile terminal according to the present invention for processing a preliminary message in consideration of a capacity allocated to a standby session. Hereinafter, a method of driving the mobile terminal will be described with reference to necessary drawings.
When the preliminary message is generated (S300), the controller 180 compares the capacity of the preliminary message with the capacity of the data allocated to the standby session (S310), and based on that, the capacity of the preliminary message is the data capacity of the standby session. It is determined whether it is larger (S320).
If the capacity of the spare message is larger than the data capacity of the standby session, the controller 180 processes the spare message so that the capacity of the spare message is smaller than the data capacity of the standby session (S330). The call is transmitted to the call receiving terminal using the standby session.
However, if the capacity of the preliminary message is not greater than the data capacity of the standby session, the controller 180 may transmit the generated preliminary message to the call receiving terminal as it is, using the standby session, to the call receiving terminal.
11 illustrates an example of reducing the capacity of a preliminary message in the mobile terminal 100 according to the present invention according to the mobile terminal driving method shown in FIG. 10.
More specifically, FIG. 11 shows that when the preliminary message including all of the obtained voices of the user is larger than the data capacity of the standby session, the capacity is reduced by deleting a part of the preliminary message. In the processed preliminary message 151 ″, the content in parentheses indicates a portion deleted by the controller 180. Meanwhile, the preliminary message shown in FIG. 11 may be a voice message or a text message converted from voice. have.
The portion deleted by the controller 180 may be a repeated word, a word that may be deleted in context, or the like. However, the scope of the present invention is not limited thereto. In addition, the controller 180 may reduce the capacity by summarizing the contents of the preliminary message in addition to deleting a part of the preliminary message.
Although not shown in the drawing, the controller 180 reserves the memory by reducing the resolution of the user's image included in the preliminary message or reducing the sampling rate of the voice message included in the preliminary message. You can also reduce the capacity of the message.
12 is a flowchart illustrating still another example of a method for driving a mobile terminal according to the present invention. Hereinafter, a method of driving the mobile terminal will be described with reference to necessary drawings.
A preliminary message is generated and transmitted (S400), but the call connection fails (S410). In operation S420, the user interface including the application list for transmitting the preliminary message to the call receiving device is displayed separately from the execution of the call application.
Through the user interface, a user interface (that is, an execution screen of the selected application) for transmitting the preliminary message using the selected application is executed through the display unit 151 through the display unit 151 (S430). ).
13 (a) shows that a preliminary message generated at the call originating terminal is received before the call is connected. In the state (a) of FIG. 13, the call connection fails. Then, the controller 180 displays the user interface 151F on the touch screen 151 for determining whether to transmit the preliminary message generated as shown in FIG. 13B to the call receiving terminal.
In the user interface, a user touches a send button. Then, the controller 180 touch screen the user interface 151G including an application list for selecting an application for transmitting the preliminary message to the call receiving terminal, as shown in (a) of FIG. 14. (151).
The user selects a specific SNS application in the user interface 151G. Then, the controller 180 transmits the preliminary message to the call receiving terminal by executing the selected SNS application as shown in (b) of FIG. 14. Referring to FIG. 14B, it can be seen that the preliminary message 151H is transmitted to the call receiving terminal through the SNS application like the message created in the selected SNS.
Meanwhile, the controller 180 may omit the process of providing the user interface 151F illustrated in FIG. 13B and may perform the process of providing the user interface 151G illustrated in FIG. 14A. In addition, the controller 180 may automatically transmit the preliminary message to the call receiving terminal by executing a predetermined application for transmitting the preliminary message when the call origination procedure is terminated due to the failure of the call connection.
Meanwhile, an application list provided for transmitting the preliminary message may be set differently according to a call receiving terminal. This will be described in more detail with reference to FIG. 15.
Comparing FIG. 15A with FIG. 15B, in order to transmit a preliminary message, the number of applications provided through the user interface 151G1 for the call counterpart A is 151G2 for the call counterpart B. ) Shows a lot more than the number of applications provided. More specifically, it can be seen that the message counterpart and the email application are provided to the call counterpart B as compared to A.
This may be due to the difference in call history of the call originator for the call counterparts A and B. And, this may be due to the difference in the social network formation history for the call counterparts A and B of the user. In addition, this may vary depending on a predetermined setting by the user. Given that the call history or social network formation history for the called party is based on or associated with the identification means for the called party's terminal, the list of applications provided for the called party is the called party's terminal (i.e., the call receiving terminal). It may vary depending on.
Referring to (a) and (c) of FIG. 15, the call counterpart C is further provided with a Bluetooth application and a Wi-Fi application for transmitting a preliminary message compared to the call counterpart A through the user interface 151G3, while the 'line' application is provided. It can be seen that is not provided.
16 illustrates that even when a call is terminated after a call connection, the mobile terminal according to the present invention provides the user interface 151G for preliminary message transmission. The application list included in the user interface 151G may also vary according to the call receiving terminal.
17 and 18 illustrate an example in which a preliminary message transmitted from the mobile terminal 100 according to the present invention is provided as a call history of a call receiving device.
Referring to FIG. 17A, when the call connection with the call receiving device fails, the preliminary message 151A 'is included in the missed call history and displayed on the display unit 151' of the call receiving device. Able to know.
Referring to FIG. 17B, preliminary messages 151A 'transmitted from the mobile terminal 100 according to the present invention are included in a call log of a call receiving terminal, thereby displaying the display unit 151' of the call receiving device. You can see that displayed on.
FIG. 18A illustrates that a touch on a history including a preliminary message 151A 'transmitted from the mobile terminal 100 is received from the call log provided to the call receiving terminal. Then, as shown in (b) of FIG. 18, the call receiving terminal may display all of the preliminary messages 151A 'transmitted from the mobile terminal 100 included in the history on the display unit.
19 to 23 illustrate examples of generating a preliminary message based on a user's voice in the mobile terminal 100 according to the present invention.
Referring to FIG. 19, it can be seen that the mobile terminal 100 according to the present invention analyzes a voice of a user (that is, a call originator) and adds an emoticon according to the user's tone to a preliminary message. More specifically, in FIG. 19, the mobile terminal 100 adds a heart-shaped emoticon 151A 'to the preliminary message in accordance with the lovely tone of the user.
Referring to FIG. 20, it can be seen that the mobile terminal 100 can vary the size of the text constituting the preliminary message according to the size of the voice of the user.
Referring to FIG. 21, the mobile terminal 100 may analyze the voice of the user and add an image corresponding to the analysis result to the preliminary message. More specifically, in FIG. 21, the mobile terminal 100 recognizes the urgency of the situation as a result of voice analysis of the user, and has added an image 151I to the preliminary message to inform the urgency thereof.
Referring to FIG. 22, it can be seen that the mobile terminal 100 can add a call originator's name 151A'2 not included in the acquired user's voice to the preliminary message. In this case, the call receiver can look up the received preliminary message 151A 'to know from whom the call is received. The mobile terminal 100 may perform this operation when the identification means of the call originating terminal is not stored in the call receiving terminal.
Referring to FIG. 23, it can be seen that the mobile terminal 100 analyzes a user's voice and generates a preliminary message by changing a half speech into a respectful speech. The mobile terminal 100 may perform this operation according to the group of the address book to which the call recipient belongs.
When the call origination request is received, the controller 180 transmits a call reception request message to the call receiving device (S500). Then, when a response message corresponding to the call reception request message is received through the wireless communication unit 110, the controller 180 determines an operation state of the call receiving device based on the received response message (S510). ).
Then, the controller 180 reflects the operation state of the call receiving device and sets the information acquisition time for generating the preliminary message and the preliminary message transmission method (S520). Herein, the information acquisition time for generating the preliminary message means a time for acquiring information that is a basis for generating the preliminary message through the information acquisition means described above.
Then, the controller 180 generates a preliminary message based on the information obtained through the information obtaining means, and transmits the generated preliminary message to the call receiving device according to the set preliminary message transmission method (S530). .
When the call receiving device is in a callable state, an embodiment of generating a preliminary message by using information obtained until a standby session is formed and transmitting the preliminary message through a data section allocated to the standby session has been described above. In addition, when the call reception device is in a callable state or when the call connection fails, an embodiment of providing a user interface for selecting an application for transmitting a preliminary message and executing the selected application in the provided user interface to transmit the preliminary message We also looked at it. Therefore, detailed description of these two will be omitted.
Hereinafter, the generation and transmission of a preliminary message when the call receiving terminal is in a call or when the call receiving terminal is powered off will be described with reference to FIGS. 25 to 28.
FIG. 25 is a flowchart illustrating an example of a method of driving a mobile terminal shown in FIG. 14. This will be described below with reference to necessary drawings.
When the response message is received through the step S500, the controller 180 determines that the call receiving device is busy based on the response message (that is, based on the information included in the response message) (S511).
Then, the controller 180 generates a preliminary message by using information obtained through the information acquiring means before the call origination procedure ends. Then, the call origination procedure is terminated (S521). Here, the termination of the call origination procedure may include a case in which the call origination procedure is terminated according to the setting of the mobile terminal 100 without the user's involvement, and a case in which the call origination procedure is forcibly terminated based on the user's operation. have.
Then, the controller 180 provides a user interface for selecting an application for transmitting the generated preliminary message through the display unit 151 (S531). In operation S541, the preliminary message is transmitted to the call receiving terminal by executing the application selected in the user interface.
Meanwhile, unlike FIG. 25, when it is determined that the call receiving device is in a call, the mobile terminal 100 according to the present invention obtains information after the call origination request is received or before the formation of a standby session after the call reception request message is transmitted. The preliminary message may be generated based on the information obtained through the preliminary message, and then the preliminary message may be transmitted to the call receiving device using the data interval allocated to the standby session. Then, the mobile terminal 100 may terminate the call origination procedure.
FIG. 26 is a flowchart illustrating another example of a method for driving a mobile terminal shown in FIG. 24. This will be described below with reference to necessary drawings.
When the response message is received through the step S500, the controller 180 determines that the call reception device is powered off based on the response message (that is, based on the information included in the response message) (S512).
Then, the controller 180 generates a preliminary message by using the information obtained through the information obtaining means before forming the standby session (S522). In operation S532, a preliminary message is transmitted to the call receiving device by using the data interval allocated to the standby session.
On the other hand, unlike shown in Figure 25, when it is determined that the call receiving device is busy, the mobile terminal 100 according to the present invention uses the information obtained through the information obtaining means before the end of the call origination procedure to send a preliminary message A user interface may be provided for generating and selecting an application for transmitting the generated preliminary message.
On the other hand, before the end of the call origination procedure may be before the formation of the standby session, the call origination procedure may be terminated according to the setting of the mobile terminal 100 without the involvement of the user, or based on the user's operation It may include the case where the calling procedure is forcibly terminated.
FIG. 27 illustrates examples in which a preliminary message is generated and transmitted when a call is possible with a call receiving device according to the method of driving a mobile terminal shown in FIG.
Referring to FIG. 27A, a call origination request by a user is received. Then, the controller 180 starts obtaining information for generating a preliminary message. Then, the call reception request message is transmitted to the call receiving terminal, and then a response message is received.
Then, the controller 180 analyzes the data included in the response message and determines that the call receiving device is in a callable state. Then, the controller 180 generates a preliminary message based on the information acquired through the information acquiring means until the standby session is formed, and uses the data section allocated to the standby session to generate the preliminary message. Send to the receiving device.
Referring to FIG. 27B, when a call origination request by the user is received, the controller 180 transmits a call reception request message to a call reception device and then starts obtaining information for generating a preliminary message. Then, a response message to the call reception request message is received by the mobile terminal 100.
Then, the controller 180 analyzes the data included in the response message and determines that the call receiving device is in a callable state. However, the call connection fails and the call origination procedure ends. Then, the controller 180 generates a preliminary message based on the information obtained through the information acquiring means until the call origination procedure ends.
Then, the controller 180 provides a user interface for selecting an application for preliminary message transmission, and executes the application selected by the user in the user interface to transmit the generated preliminary message to the call receiving device. .
Although not shown in FIG. 27, the information acquisition start time for generating the preliminary message may be a specific time point between receiving a call origination request and transmitting a call reception request message, and a specific time point after receiving a call reception request message and before receiving a response message. It may be. And it may be a specific time point arbitrarily determined by the user. However, the scope of the present invention is not limited to the above-described viewpoints. The same is true in the embodiments of FIG. 28.
In addition, the information acquisition end time for generating the preliminary message may be a specific time point before the formation of the standby session after receiving the response message in FIG. 27A, and may be after the end of the call origination procedure in FIG. 27B. . And, it may be an arbitrary time point determined by the user. However, the scope of the present invention is not limited to the above-described viewpoints. This also applies to the embodiments of FIG. 28.
Referring to FIG. 28A, when a call origination request by a user is received, the controller 180 transmits a call reception request message to a call reception device, and then a response message to the call reception request message is transmitted to the mobile terminal. 100 is received. Meanwhile, the controller 180 starts obtaining information for generating a preliminary message after the call origination request.
The controller 180 analyzes the data included in the response message and determines that the call receiving device is busy. The call origination procedure then ends. Then, the controller 180 generates a preliminary message based on the information obtained through the information acquiring means until the call origination procedure ends.
Referring to FIG. 28B, a call origination request by the user is received. Then, the controller 180 starts obtaining information for generating a preliminary message. Then, the call reception request message is transmitted to the call receiving terminal, and then a response message is received.
Then, the controller 180 analyzes the data included in the response message and determines that the call receiving device is powered off. Then, the controller 180 generates a preliminary message based on the information acquired through the information acquiring means until the standby session is formed, and uses the data section allocated to the standby session to generate the preliminary message. Send to the receiving device.
FIG. 29A illustrates that a voice of a user is obtained through the microphone 122, and FIG. 29B illustrates a display of the mobile terminal 100 in which a preliminary message generated based on the acquired voice of the user is obtained. What is displayed in the part 151 is shown.
Referring to FIG. 29 (b), it can be seen that the controller 180 of the mobile terminal 100 may divide the obtained user's voice into syllables and display the same on a plurality of speech bubbles. On the other hand, the display form of the preliminary message divided into a plurality of parts is not limited to the speech bubble form as described above.
FIG. 30A illustrates that a preliminary message generated based on a voice of a user is displayed in the form of a plurality of speech bubbles 151A1, 151A2, and 151A3. In FIG. 30A, one speech bubble 151A1 is selected by a user's touch. Then, the controller 180 of the mobile terminal 100 selects a part of the preliminary message corresponding to the selected speech bubble 151A1 and transmits it to the call receiving terminal.
30B illustrates that some preliminary messages transmitted are not displayed on the display unit 151 of the mobile terminal 100.
FIG. 31A illustrates that a touch and drag is received from the first partial preliminary message 151A1 to the second partial preliminary message 151A2 while the preliminary message is displayed in the form of a plurality of speech bubbles.
Then, as shown in (b) of FIG. 31, the control unit of the mobile terminal 100 can see that the first and second partial preliminary messages are displayed together on one speech bubble 151A12. As in the example shown in FIG. 30, when the user touches the speech bubble 151A12 on which the merged message is displayed, the merged message may be selectively transmitted to the call receiving terminal.
The controller 180 of the mobile terminal 100 provides a user interface for generating a preliminary message through the display unit 151 (S600). The point of time provided by the user interface may be before a call origination request by the user is received, or may be a point in time at which a call origination procedure is received due to the call origination request being received.
A preliminary message is generated through the user interface (S610). The generation of the preliminary message through the user interface may be based on an input through a virtual keypad provided through the display unit 151 implemented as a touch screen, and displays a preliminary message stored in the storage unit 160 in advance. It may be provided through the unit 151 and the user selects at least one of them. However, the method of generating the preliminary message through the user interface in the mobile terminal 100 according to the present invention is not limited to the above examples.
The controller 180 may transmit the generated preliminary message to the call receiving device by using a data section allocated to a standby session formed before the call channel is formed with the call receiving device (S620).
FIG. 33A illustrates that the user touches a specific icon displayed on the touch screen 151 after the call reception request message is transmitted to the call reception device. Then, the controller 180 displays the preliminary message list 151K that has been previously transmitted on the touch screen 151 as shown in (b) of FIG. 33. The controller 180 may display the preliminary message list on the touch screen 151 based on a voice command, a specific word, a specific button manipulation, or the like.
As illustrated in (c) of FIG. 33, when the user touches and selects one of the preliminary message lists 151K, the controller 180 may transmit the selected preliminary message to the call reception device. Meanwhile, the preliminary message list displayed on the touch screen 151 may be a preliminary message list generated and stored by the user in advance, not previously transmitted.
If the user touches the specific contact information 151L on the execution screen of the contact application before the call origination request by the user is received, the controller 180 selects a function that can be performed using the specific contact information. The user interface 151M is displayed on the touch screen 151.
In the user interface 151M, a user touches and selects an item 151N corresponding to a preliminary message transmission function. Then, the controller 180 displays the preliminary message list 1510 that has been sent as shown in (b) of FIG. 34 on the touch screen 151.
When a touch 3 for selecting and transmitting any one of the preliminary message lists is received, the controller 180 displays call origination information 151P while transmitting a call reception request message as shown in FIG. 35. The selected preliminary message 151A may be transmitted to the call receiving device. Here, the controller 180 can transmit the selected preliminary message 151A by using a data section allocated to a standby session. In addition, the controller 180 may transmit the selected preliminary message to the call receiving device by using a data section allocated to the billing area after the call is connected.
On the other hand, as shown in (b) of FIG. 34, when touch 4 is received for an area where a content of a specific preliminary message is displayed by a user, the controller 180 displays a user interface for editing the specific preliminary message. You can also provide
Referring to FIG. 36, it can be seen that the controller 180 of the mobile terminal 100 may provide a user interface for directly writing a preliminary message based on a user's manipulation. More specifically, while the specific contact 151L is selected, the user may write a preliminary message using the virtual keyboard 151R provided through the touch screen 151. The message input through the virtual keyboard is displayed in the input window 151S. The user may execute a call origination request transmission and a preliminary message transmission function by touching the origination button 151T.
37 (a) shows that the call receiver generates a response message 151U for the preliminary message received before the call connection and transmits it to the call originating terminal. In this case, the response message 151U may also be generated based on the voice of the call receiver like the preliminary message, may be selected from pre-stored messages, or may be directly input by the user.
37 (b) shows that a response message has been transmitted to the call originating terminal, and a message indicating that the call originator is waiting is displayed on the touch screen 151 'of the call originating terminal.
38 shows an example in which the information corresponding to the analysis result of the preliminary message is transmitted to the call originating terminal together with the preliminary message in the mobile terminal 100 according to the present invention.
38 (a) shows that a preliminary message indicating that the call originator has arrived at a specific location 'Gangnam' is transmitted to the call receiving terminal. Although not displayed on the display unit 151 of the call originating terminal 100, the controller 180 of the mobile terminal 100 analyzes the preliminary message and is information corresponding to the analysis result. Is transmitted to the call receiving device for data to be displayed on the display unit 151 'of the call receiving terminal.
38B illustrates the display unit 151 of the call receiving device. Referring to FIG. 38 (b), it can be seen that the display unit 151 displays map information 151W corresponding to the analysis result together with the preliminary message 151 ′ received from the call originating terminal.
39 illustrates that a preliminary message transmitted from the mobile terminal 100 according to the present invention is output as a voice message from the call receiving terminal.
39 (a) shows that a preliminary message 151A is transmitted from the mobile terminal 100 which is a call originating terminal. 39 (b) shows that the preliminary message 151A 'is received and displayed at the call receiving terminal and the received preliminary message is output as the voice message 151X.
As described above, each of the mobile terminal driving methods according to the present invention may be implemented in a program form that can be executed by various computer means and recorded in a computer readable medium. The computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. Programs recorded on the media may be those specially designed and constructed for the present invention, or they may be of the kind well-known and available to those having skill in the computer software arts.
Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tape, optical media such as CD-ROMs, DVDs, and magnetic disks, such as floppy disks. Magneto-optical media, and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of programs include not only machine code generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like. The hardware device described above may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.
As described above, the present invention has been described by way of limited embodiments and drawings, but the present invention is not limited to the above embodiments, and those skilled in the art to which the present invention pertains various modifications and variations from such descriptions. This is possible.
Therefore, the scope of the present invention should not be limited to the described embodiments, but should be determined not only by the claims below but also by the equivalents of the claims.
100: mobile terminal 110: wireless communication unit
120: A / V input unit 121: camera
130: user input unit 140: sensing unit
150: output unit 151: display unit, touch screen
152: sound output unit 160: storage unit
170: interface unit 180: control unit
190: power supply
A wireless communication module performing a communication function with an external device;
Information obtaining means;
A display unit; And
When a call origination request is received,
Generates a call reception request message and transmits it to the call reception device;
And a controller configured to generate a preliminary message based on the information obtained through the information acquiring means and transmit the preliminary message to the call receiving device after the call origination request is received and before the call connection with the call receiving device.
The control unit,
Transmitting the preliminary message to the call receiving device using a data interval allocated to an early media session, which is formed after the call reception request message is transmitted and before the call connection with the call receiving device is established,
When the call with the call receiving device is not connected and the call origination procedure is terminated, the mobile terminal for displaying on the display a user interface for selecting an application for transmitting the preliminary message to the call receiving device. .
The method of claim 1, wherein the preliminary message,
And at least one of a voice message and a text generated based on the user's voice acquired by the information obtaining means and an image of the user photographed by the information obtaining means.
The method of claim 1, wherein the user interface,
Contains a list of applications to run when selected,
And a type of application included in the user interface according to the call receiving device.
The method of claim 1, wherein the control unit,
And when a call origination procedure is terminated without a call to the call receiving device connected, automatically transmitting the preliminary message to the call receiving device using a predetermined application.
If the capacity of the generated spare message is greater than the capacity of the data interval allocated to the standby session, the generated spare message is processed such that the capacity of the generated spare message is smaller than the capacity of the data interval allocated to the standby session. And transmit to the call receiving device.
Generating a preliminary message including text generated based on the voice of the user and transmitting the preliminary message to the call receiving device;
The text size is
Mobile terminal, characterized in that the variable according to the size of the user's voice.
A preliminary message including a text generated based on the voice of the user and an image corresponding to the analysis result of the voice of the user among a plurality of images stored in the memory is generated and transmitted to the call receiving device terminal.
The method of claim 1,
The preliminary message is included in the call history of the call receiving device.
Information obtaining means; And
A call reception request message is generated and transmitted to a call reception device, the operation state of the call reception device is determined based on a response message received corresponding to the call reception request message, and the information acquisition means is received after the call origination request is received. It includes a control unit for generating a preliminary message based on the information obtained through,
Reflecting the determined operation state of the call receiving device, and differently set the time interval for acquiring the information through the information obtaining means and the method for transmitting the preliminary message to the call receiving device to generate the preliminary message;
If the call receiving device is in a callable state,
Generating a preliminary message based on the information obtained through the information acquiring means after receiving the call origination request and forming a standby session;
The mobile terminal transmits the generated preliminary message to the call receiving device using a data section allocated to a standby session.
The method of claim 12, wherein when the call receiving device is busy,
Generating a preliminary message based on the information obtained through the information acquiring means after receiving the call origination request and before forming a standby session;
And transmitting the generated preliminary message to the call receiving device by using a data section allocated to the standby session.
Generating a preliminary message based on the information obtained through the information acquiring means after receiving the call origination request and before ending the call origination procedure;
And displaying on the display a user interface for selecting an application for transmitting the preliminary message to the call receiving device.
The method of claim 12, wherein if the call receiving device is powered off,
The method of claim 17, wherein the user interface,
The method of claim 12,
KR1020130084290A 2013-07-17 2013-07-17 Mobile terminal KR102018376B1 (en)
KR1020130084290A KR102018376B1 (en) 2013-07-17 2013-07-17 Mobile terminal
US14/325,200 US9565289B2 (en) 2013-07-17 2014-07-07 Mobile terminal and method of controlling the same
EP14177070.1A EP2827571A1 (en) 2013-07-17 2014-07-15 Mobile terminal and method of controlling the same
CN201410341914.4A CN104301872A (en) 2013-07-17 2014-07-17 Mobile terminal and method of controlling the same
KR20160022645A (en) * 2014-08-20 2016-03-02 삼성전자주식회사 Method for transmitting data and electronic device thereof
KR101654301B1 (en) * 2015-02-25 2016-09-05 에스케이텔레콤 주식회사 Apparatus And Computer-Readable Recording Medium with Program for Providing Sticker Information
KR101712352B1 (en) * 2016-08-10 2017-03-06 에스케이 텔레콤주식회사 Apparatus And Computer-Readable Recording Medium with Program for Providing Sticker Information
US10238316B2 (en) 2017-05-17 2019-03-26 Rehabit Llc Passive five sensor insole real-time feedback device
US20190069142A1 (en) * 2017-08-31 2019-02-28 T-Mobile Usa, Inc. Real time text transmission before establishing a primary communication session
US20110014932A1 (en) * 2009-07-17 2011-01-20 Texas Instruments Incorporated Mobile Telephony Combining Voice and Ancillary Information
US6424828B1 (en) * 1999-06-03 2002-07-23 Ericsson Inc. Internet server and method for providing access to internet e-mail and internet web pages
JP2005316650A (en) 2004-04-28 2005-11-10 Sony Corp Communication terminal and content selection presentation method
KR100705253B1 (en) * 2005-01-06 2007-04-10 에스케이 텔레콤주식회사 Terminal for interworking with user centric phone book, user centric phone book service system and method thereof
WO2007037155A1 (en) 2005-09-29 2007-04-05 Access Co., Ltd. Telephone terminal having presence modification function and presence system using the telephone terminal
KR101386169B1 (en) 2007-08-09 2014-04-17 삼성전자주식회사 Apparatus and method for compression and restoration SMS
US8265247B2 (en) * 2009-02-26 2012-09-11 Research In Motion Limited Method of providing message information, including call subject information, to a recipient of a telephone call
KR20110041864A (en) * 2009-10-16 2011-04-22 엘지전자 주식회사 Method for attaching data and mobile terminal thereof
CN102055726B (en) 2009-10-29 2014-06-11 中兴通讯股份有限公司 Method and mobile terminal for realizing polychrome service
US20130148646A1 (en) * 2011-12-13 2013-06-13 Tzahi Efrati Systems and methods of providing communications services
US8433336B2 (en) 2013-04-30 Method for guiding route using augmented reality and mobile terminal using the same
JP5813863B2 (en) 2015-11-17 Private and public applications
US9456298B2 (en) 2016-09-27 Device-to-device location awareness
US8892168B2 (en) 2014-11-18 Mobile terminal and method of managing display of an icon in a mobile terminal
US8990721B2 (en) 2015-03-24 Mobile terminal and method of controlling the same
US9026940B2 (en) 2015-05-05 Mobile terminal and method of managing object related information therein
US8854315B2 (en) 2014-10-07 Display device having two touch screens and a method of controlling the same
KR101935038B1 (en) 2019-01-03 Mobile terminal and method of controlling the same
EP2397936B1 (en) 2019-08-07 Mobile terminal and method of controlling the same
US9124712B2 (en) 2015-09-01 Options presented on a device other than accept and decline for an incoming call
US20130176298A1 (en) 2013-07-11 Mobile terminal and method of controlling the same
KR20100127081A (en) 2010-12-03 Function execution method and apparatus thereof
KR20130043150A (en) 2013-04-29 Pre-fetching information based on gesture and/or location
KR20100007625A (en) 2010-01-22 Mobile terminal and method for displaying menu thereof
KR20100133621A (en) 2010-12-22 Mobile terminal and method for controlling the same
EP2571234A1 (en) 2013-03-20 Mobile terminal and method for controlling the same
KR20120116147A (en) 2012-10-22 Mobile terminal performing remote control fucntion for display device
EP2254313A1 (en) 2010-11-24 Mobile terminal and method of executing call function using the same
RU2536799C1 (en) 2014-12-27 Mobile terminal and control method therefor
CN102446060B (en) 2016-01-06 The method of mobile terminal and control mobile terminal
KR101850821B1 (en) 2018-04-20 Mobile terminal and message display method for mobile terminal
US8103296B2 (en) 2012-01-24 Mobile terminal and method of displaying information in mobile terminal
KR20100124591A (en) 2010-11-29 Mobile terminal system and control method thereof
2018-07-09 AMND Amendment
2019-07-04 E601 Decision to refuse application
2019-08-13 X701 Decision to grant (after re-examination)