AU2014349144B2 - Unmanned vehicle searches - Google Patents
Unmanned vehicle searches Download PDF
AU2014349144B2
AU2014349144B2 AU2014349144A AU2014349144A AU2014349144B2 AU 2014349144 B2 AU2014349144 B2 AU 2014349144B2 AU 2014349144 A AU2014349144 A AU 2014349144A AU 2014349144 A AU2014349144 A AU 2014349144A AU 2014349144 B2 AU2014349144 B2 AU 2014349144B2
AU2014349144A
AU2014349144A1 (en
Amy C. ARBEIT
Christopher W. Lum
Insitu Inc
2014-08-29 Application filed by University of Washington, Insitu Inc filed Critical University of Washington
2016-02-18 Publication of AU2014349144A1 publication Critical patent/AU2014349144A1/en
2017-10-05 Assigned to UNIVERSITY OF WASHINGTON, INSITU, INC. reassignment UNIVERSITY OF WASHINGTON Amend patent request/document other than specification (104) Assignors: INSITU, INC. (A SUBSIDIARY OF THE BOEING COMPANY), UNIVERSITY OF WASHINGTON
2018-08-02 Publication of AU2014349144B2 publication Critical patent/AU2014349144B2/en
230000010006 flight Effects 0 abstract claims description 114
238000004422 calculation algorithm Methods 0 claims description 29
238000005457 optimization Methods 0 claims description 23
239000003570 air Substances 0 claims description 10
239000003138 indicator Substances 0 description 3
230000002104 routine Effects 0 description 2
230000036545 exercise Effects 0 description 1
239000003897 fog Substances 0 description 1
230000001902 propagating Effects 0 description 1
238000009419 refurbishment Methods 0 description 1
230000003578 releasing Effects 0 description 1
230000001052 transient Effects 0 description 1
238000007514 turning Methods 0 description 1
G08—SIGNALLING
G08G—TRAFFIC CONTROL SYSTEMS
G08G5/00—Traffic control systems for aircraft, e.g. air-traffic control [ATC]
G08G5/0047—Navigation or guidance aids for a single aircraft
G08G5/0069—Navigation or guidance aids for a single aircraft specially adapted for an unmanned aircraft
G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
G01C21/00—Navigation; Navigational instruments not provided for in preceding groups G01C1/00-G01C19/00
G01C21/20—Instruments for performing navigational calculations
G01C23/00—Combined instruments indicating more than one navigational value, e.g. for aircraft; Combined measuring devices for measuring two or more variables of movement, e.g. distance, speed, acceleration
G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
G05D1/00—Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
G05D1/0094—Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot involving pointing a payload, e.g. camera, weapon, sensor, towards a fixed or moving target
G05D1/02—Control of position or course in two dimensions
G05D1/0202—Control of position or course in two dimensions specially adapted to aircraft
G08G5/0004—Transmission of traffic-related information to or from an aircraft
G08G5/0013—Transmission of traffic-related information to or from an aircraft with a ground station
G08G5/0017—Arrangements for implementing traffic-related aircraft activities, e.g. arrangements for generating, displaying, acquiring or managing traffic information
G08G5/0026—Arrangements for implementing traffic-related aircraft activities, e.g. arrangements for generating, displaying, acquiring or managing traffic information located on the ground
G08G5/003—Flight plan management
G08G5/0034—Assembly of a flight plan
G08G5/0039—Modification of a flight plan
G08G5/006—Navigation or guidance aids for a single aircraft in accordance with predefined flight zones, e.g. to avoid prohibited zones
B64—AIRCRAFT; AVIATION; COSMONAUTICS
B64C—AEROPLANES; HELICOPTERS
B64C2201/00—Unmanned aerial vehicles; Equipment therefor
B64C2201/12—Unmanned aerial vehicles; Equipment therefor adapted for particular use
B64C2201/127—Unmanned aerial vehicles; Equipment therefor adapted for particular use for photography, or video recording, e.g. by using cameras
B64C2201/14—Unmanned aerial vehicles; Equipment therefor characterised by flight control
B64C39/00—Aircraft not otherwise provided for
B64C39/02—Aircraft not otherwise provided for characterised by special use
B64C39/024—Aircraft not otherwise provided for characterised by special use of the remote controlled vehicle type, i.e. RPV
G08G5/0021—Arrangements for implementing traffic-related aircraft activities, e.g. arrangements for generating, displaying, acquiring or managing traffic information located in the aircraft
A method of planning a flight path for a search can include receiving, by a control system, an indication of a search area boundary; receiving, by the control system, an indication of a selected search pattern; determining, by the control system, a flight path based on the search area boundary and the selected search pattern; and transmitting one or more indications of the flight path to an unmanned aerial vehicle.
UNMANNED VEHICLE SEARCHES
[0001] The present application is generally related to the use of unmanned aerial vehicles (UAVs) in search efforts.
[0002] UAVs can be useful in a number of settings. Searching efforts for potential targets are some of the settings in which UAVs can be useful. Searches can be made in search-and-rescue efforts can include searches for potential targets, such as lost hikers, downed pilots, lost vehicles, disabled boats, lifeboats, and many other possible potential targets that could benefit from rescue. Other search efforts can include reconnaissance searches (such as in a military setting), searches for physical items (such as portions of downed aircraft or spacecraft), and the like.
[0003] UAV control typically includes a controller operating at a control system. The control system accepts inputs from the controller and transmits information wirelessly to a UAV in flight. The UAV can respond to the signals sent by the control system to change operation of the UAV, such as by changing a flight path, changing an elevation, releasing payload (e.g., a weapon), changing operation of payload (e.g., a camera or sensor), and the like. Control of a UAV can be difficult, just as control of a manned air vehicle can be difficult for a pilot. When additional tasks and responsibilities are placed on a UAV controller, such as controlling a search by the UAV, control of the UAV can become even more difficult.
[0004] Illustrative examples of the present disclosure include, without limitation, methods, structures, and systems. In one aspect, a method of planning a flight path for a search, the method comprising: receiving, by a control system, an indication of a search area boundary; receiving, by the control system, an indication of a selected search pattern; determining, by the control system, the flight path based on the search area boundary, the selected search pattern, and an optimization algorithm, the optimization algorithm configured to direct the search to search regions within the search area boundary based on a likelihood that a search target is located within the search regions, wherein the likelihood is based on a number of times the search has been performed in the search regions and terrain of the search regions; and transmitting one or more indications of the flight path to an unmanned aerial vehicle.
[0004a] In another aspect, a system for displaying target search probabilities, the system comprising: a control unit configured to determine, based on an optimization algorithm, a search area to be searched, the optimization algorithm configured to direct a search to search regions within a search area boundary based on a likelihood that a search target is located within the search regions, wherein the likelihood is based on a number of times the search has been performed in the search regions and terrain of the search regions; a sensor mounted on an air vehicle, the sensor configured to determine a direction and a distance to the search area; and a camera mounted on the air vehicle, the camera configured to take one or more images of the search area; wherein the control unit is further configured to: receive, from the sensor, an indication of the direction and the distance to the search area, and control an orientation and a zoom of the camera based on the indication of the direction and the distance to the search area received from the sensor.
[0004b] In another aspect, a method of planning a flight path for a search, the method comprising: receiving, by a control system, an indication of a search area boundary; receiving, by the control system, an indication of a selected search pattern; identifying a no-fly zone, wherein at least a portion of the no-fly zone overlaps at least a portion of the search area boundary; determining, by the control system, the flight path based on the search area boundary, the selected search pattern, the no-fly zone, an optimization algorithm, and at least one specification of an unmanned aerial vehicle, the optimization algorithm configured to direct the search to search regions within the search area boundary based on a likelihood that a search target is located within the search regions, wherein the likelihood is based on a number of times the search has been performed in the search regions and terrain of the search regions; and transmitting one or more indications of the flight path to the unmanned aerial vehicle.
[0004c] In another aspect, a system comprising: an unmanned aerial vehicle configured to fly over one of a plurality of search areas; a slewing mechanism mounted on the unmanned aerial vehicle; a control unit configured to determine one search area from the plurality of search areas to be searched based on an optimization algorithm and to control the slewing mechanism based on the determination of the one search area to be searched, the optimization algorithm configured to a search to search regions within a search area boundary based on a likelihood that a search target is located within the search regions, wherein the likelihood is based on a number of times the search has been performed in the search regions and terrain of the search regions; and a camera mounted on the slewing mechanism, wherein the camera is configured to take one or more images of the one search area to be searched.
[0005] In one example, the selected search pattern comprises at least one of a trackline search pattern, a parallel search pattern, a creeping line search pattern, an expanding square search pattern, and a sector search pattern. The method could also include receiving a pattern direction where determining the flight path comprises determining the flight path based further on the pattern direction. The method could also include displaying the flight path on a display of a map. An update of one or more of the selected search pattern or a track spacing of the selected search pattern may be received by the control system. When an update is received of one or more of the selected search pattern or track spacing of the selected search pattern, the displayed flight path on the display of the map can be updated.
[0006] In another aspect, a system for displaying target search probabilities can include a control unit, a sensor mounted on an air vehicle, and a camera mounted on the air vehicle. The control unit can be configured to determine, based on an optimization algorithm, a search area to be searched. The sensor can be configured to determine a direction and a distance to the search area. The camera can be configured to take one or more images of the search area. The control unit can also be configured to receive, from the sensor, an indication of the direction and the distance to the search area, and control an orientation and a zoom of the camera based on the indication of the direction and the distance to the search area received from the sensor.
[0007] In one example, the system can further include a display configured to display a plurality of search regions and to display, in one or more of the plurality of search regions, an indication of a likelihood that a search target is located in each of the one or more of the plurality of search regions. In another example, the indication of the likelihood that the search target is located in each of the one or more of the plurality of search regions can include one or more of a shading of the one or more of the plurality of search regions, a color of the one or more of the plurality of search regions, and a numerical indicator in the one or more of the plurality of search regions. In another example, the likelihood that the search target is located in each of the one or more of the plurality of search regions can be calculated based on one or more of information about the terrain of the one or more of the plurality of search regions, information about conditions during a search of the one or more of the plurality of search regions, and information about the search target.
[0008] In another aspect, a method of planning a flight path for a search can include receiving, by a control system, an indication of a search area boundary;
In one example, the method can also include displaying the flight path on a display of a map. The no-fly zone can he defined as any type of polygon or any other shape.
The flight path can be determined such that the unmanned aerial vehicle searches portions of the search area boundary th at are outside of the no-fly zone. The specifi cati on of the unmann ed aerial vehicle can include a minimum turn radius. The control system can be configured to automatically determine the flight path. The control system can be further configured to automatically determine the flight path at least partially simultaneously while a controller of the unmanned aerial vehicle is con trolling another aspect of the unmanned aerial vehicle.
In another aspect, a system can include an unmanned aerial vehicle, a slewing mechanism mounted on the unmanned aerial vehicle, a control unit, and a camera mounted on the slewing mechanism. The control unit can be configured determine an area to be searched based on an optimization algorithm and to control the slewing mechanism based on the determination of the area to be searched. The camera can be configured to take one or more images of the area to be searched .
Other features of the methods, structures, and systems are described below. The features, functions, and advantages can be achieved independently in various examples or may be combined in yet other examples, further details of which can be seen with reference to the following description and drawings.
Throughout the drawings, reference numbers may be re-used to indicate correspondence between referenced elements. The drawings are provided to illustrate examples described herein and are not intended to limit the scope of the disclosure.
Figure 1 depicts a flow diagram of an aircraft production and service methodology.
Figure 2 depicts a block diagram of an aircraft.
Figure 3 depicts a block diagram illustrating systems or operating environments for controlling unmanned aerial vehicles (UAVs).
Figures 4A-4F depict an example of steps of generating a search flight path for aUAV.
Figures 5A-5E depict examples of search patterns.
Figure 6 depicts an example of a method 600 including steps of generating a search flight path for a UAV by a control system.
Figures 7A and 7B depict an example of a search flight path generated for UAV to search a search area that includes a no-fly zone.
Figure 8 depicts a slewing mechanism mounted to a UAV.
Figure 9 depicts an example of a target probability map.
Figure 10 depicts an illustration of an example computing environment in which operations according to the disclosed subject matter may be performed.
Examples in this disclosure may be described in the context of aircraft manufacturing and service method 100 as shown in Figure I and an aircraft 200 as shown in Figure 2. During pre-production, aircraft manufacturing and service method 100 may include specification and design 102 of aircraft 200 and material procurement 104,
During production, component and subassembly manufacturing 106 and system integration 108 of aircraft 200 takes place. Thereafter, aircraft 200 may go through certification and delivery 110 in order to be placed in service 112. While in service by a customer, aircraft 200 is scheduled for routine maintenance and service 114 ( winch may also include modification, reconfiguration, refurbishment, and so on).
Each of the processes of aircraft manufacturing and serv ice method 100 may be performed or carried out by a system integrator, a third party, and/or an operator (e.g,, a customer). For the purposes of this description, a system integrator may include, without limitation, any number of aircraft manufacturers and major-system subcontractors; a third party may include, for example, without limitation, any number of venders, subcontractors, and suppliers; and an operator may be an airline, leasing company, military entity, service organization, and so on.
As shown in Figure 2, aircraft 200 produced by aircraft manufacturing and service method 100 may include airframe 202 with a plurality of systems 204 and interior 206. Examples of systems 204 include one or more of propulsion system 208, electrical system 210, hydraulic system 212, and environmental system 214. Any number of other systems may be included in this example. Although an aerospace example is shown, the principles of the disclosure may be applied to other industries, such as the automotive industry.
Apparatus and methods embodied herein may be employed during any one or more of the stages of aircraft manufacturing and service method 100. For example, without limitation, components or subassemblies corresponding to component and subassembly manufacturing 106 may be fabricated or manufactured in a manner similar to components or subassemblies produced while aircraft 200 is in sendee.
Figure 3 illustrates systems or operating environments, denoted generally at 300, that provide flight plans for UAVs while routing around obstacles having spatial and temporal dimensions. These systems 300 may include one or more flight planning systems 302. Figure 3 illustrates several examples of platforms that may host the flight planning system 302. These examples may include one or more server-based systems 304, one or more portable computing systems 306 (whether characterized as a laptop, notebook, tablet, or other type of mobile computing system), and/or one or more desktop computing systems 308. As detailed elsewhere herein, the flight planning system 302 may be a ground-based system that performs pre-flight planning and route analysis for the UAVs, or may be a vehicle-based system that is housed within the UAVs themselves.
Implementations of this description may include other types of platforms as well, with Figure 3 providing non-limiting examples. For example, the description herein contemplates other platforms for implementing the flight planning systems, including but not limited to wireless personal digital assistants, smartphones, or the like. The graphical elements used in Figure 3 to depict various components are chosen only to facilitate illustration, and not to limit possible implementations of the description herein.
Turning to the flight planning system 302 in more detail, it may include one or more processors 310, which may have a particular type or architecture, chosen as appropriate for particular implementations. The processors 310 may couple to one or more bus systems 312 that are chosen for compatibility with the processors 310.
The flight planning systems 302 may include one or more instances of computer-readable storage media 314, which couple to the bus systems 312. The bus systems may enable the processors 310 to read code and/or data to/from the computer-readable storage media 314. The media 314 may represent storage elements implemented using any suitable technology, including but not limited to semiconductors, magnetic materials, optics, or the like. The media 314 may include memory components, whether classified as RAM, ROM, flash, or other types, and may also represent hard disk drives.
The storage media. 314 may include one or more modules 316 of instructions that, when loaded into the processor 310 and executed, cause the system 302 to provide flight plan computation services for a variety of UAVs 318. These modules may implement the various algorithms and models described and il lustrated herein.
The UAVs 318 may be of any convenient size and/or type as appropriate for different applications. In different scenarios, the UAVs may range from relatively small drones to relatively large transport aircraft. Accordingly, the graphical illustration of the UAV 318 as shown in FIG, 1 is representative only, and is not drawn to scale.
The flight plan services 316 may generate respective flight plan solutions 320 for the UAVs 318 based on inputs 322, with flight planning personnel 324 and/or one or more databases 326 providing inputs 322.
Assuming that the flight plan sendees 316 define one or more solutions 320, the flight planning system 302 may load the solutions into the UAVs 318, as represented by the arrow connecting blocks 302 and 318 in Figure 3. In addition, the flight planning system 302 may also provide the solutions 320 to the flight planner 324 and/or the databases 326, as denoted by the arrow 320A.
Figures 4A-4F depict an example of steps of generating a search flight path for a UAV. Figure 4A depicts a display of a topographical map 400. The topographical map 400 includes a depiction of a body of water 401 and land 402. Fi gure 4B depicts the same topographical map 400. Figure 4B also depicts a search area boundary 403. The search area boundary 403 can be entered into a control system by a UAV controller 403. For example, if the topographical map 400 is depicted on a touchscreen display of the control system, a UAV controller can enter the search area boundary 403 by drawing the search area boundary on the touchscreen over the topographical map. The search area boundary 403 can also be entered into a control system in an number of other ways, such as by entering coordinates of the comers of the search area boundary 403, by entering headings and distances of each of the sides of the search area boundary 403, and the like. After the search area boundary 403 has been entered into the control system, the control system can display the search area boundary' 403 on the topographical map 400, as shown in Figure 4B.
Figure 4C depicts the topographical map 400 overlayed with the search area boundary 403. Figure 4C also depicts search regions 404. The control system can determine the size and shape of the search regions 404. The size and shape of the search regions 404 can be based on one or more of a size of a particular target of a search, based on a shape of the particular object of a search, based on a size and shape of the search area boundary' 403, and the like. In the depiction shown in Figure 4C, the search regions 404 can include a number of square regions. The search regions 404 could also take the form of other shapes, such as triangles, rectangles, pentagons, hexagons, and the like. As is also shown in Figure 4C, the search regions 404 can cover the entire area bounded by the search area boundary 403. Portions of the search regions 404 can fail outside of the search area boundary 403. The depicted search regions can be part of a target probability map, which is described in greater detail below.
In addition to entering the search area boundary 403 into a control system, a UAV controller can also enter an indication of a search pattern into the control system.
Examples of search patterns are depicted in Figures 5A-5E.
Figure 5A depicts an example of a trackline search pattern. A trackline search pattern typically is used when a search target's intended route is known. This search pattern is usually the first search action since it is assumed that the target is near the intended route, in Figure 5A, the origin, the intended route, and the intended destination arc depicted, along with a trackline search pattern.
Figure 5B depicts an example of a parallel search pattern. A parallel search pattern can be used when a search area is large and the probability of the target being anywhere in the search area is substantially the same. The search legs generally run parallel to the longer side of the search area.
Figure 5C depicts an example of a creeping line search pattern. A creeping line search pattern is typically used when the search area is large, uniform coverage is desired, and there is more chance of the target being in one end of the search area than the other. The search legs generally run parallel to the shorter side of the search area.
Figure 5D depicts an example of an expanding square search pattern. An expanding square search pattern is used when a central location for a start point is known and uniform coverage is desired. The direction of the first l eg can be determined based on an desired direction. All turns are at substantially right angles.
Figure 5E depicts an example of a sector search pattern. A sector search pattern is typically used when a search target is difficult to detect. The pattern resembles the spokes of a wheel, with the center of the wheel at datum point. The search vehicle passes through the datum point several times, each time increasing the chances of finding the target. A sector search pattern can include turns of approximately 60°, with the search pattern defining nine substantially equal legs, each leg having a length substantially equal to the radius of the search area.
In addition to those search patterns depicted in Figures 5 A-5E, many other possible search patterns are possible. When entering the search pattern, the U AV controller can select one search pattern from a list possible search patterns, the UAV controller can type in a name of the search pattern, the UAV controller can draw an approximation of the search pattern on a map, and the UAV controller can enter the search pattern in any other way.
Figure 4D depicts a flight path 405 overlayed on a display of a map. A UAV controller may have entered an expanding rectangle tracking pattern, in this case, the control system can determine the flight path 405 based on the search area boundary 403 and the search pattern specified by the UAV controller. The flight path 405 can be defined by a plurality of waypoints 406. For example, the control system may determine that the search flight path 405 should start at waypoint 406a, continue to waypoint 406b, and then on to waypoints 406c, 406d, and 406e. The first waypoint 406a can be based on a location that will allow for the selected search pattern to be completed, based on an estimated or expected location of the target, based on a user input of a particular start location, and the like. The control system can also determine an initial direction to start the search pattern or the control system can receive an input from a UAV controller indicative of a search pattern direction. The control system's determination of the flight path 405 can be based on the received indication of the pattern direction. The control system can transmit an indication of the flight path 405 to the UAV while in flight. The control system can transmit the flight path 405 to the UAV by transmitting indications of the waypoints 406 to the UAV.
Each of the waypoints 406 depicted in Figure 4D is located inside one of the search regions 404 and much of the flight path 405 follows along the middle of the search regions 404. However, the waypoint 406 do not necessarily need to be located in the middle search regions 404 and the flight path 405 does not necessarily need to follow along the middle of the search regions 404.
Figure 4E depicts additional portions of the flight path 405. The after passing through the waypoints 406a-406e, the UAV can pass through waypoints 406f~406j. The control system can determine the waypoints 406f-406j and transmit indications of the waypoints 406f-406j to the UAV. In one example, all of the waypoints 406 can be transmitted to the UAV in a single transmission, in another example, particular subsets of the waypoints 406 can be transmitted to the UAV, such as a first transmission of the waypoints 406a-406e followed by a second transmission of the waypoints 406f-406j, In this latter example, the passing of waypoints 406 to the UAV in separate subsets can reduce the amount of communication to the UAV that would occur at any given time. For example, a control system can transmit indications of waypoints 406a-406e to the UAV and, while the UAV is flying between waypoint 406a and waypoint 406e, the control system can then transmit indications of waypoints 4Q6f-406j. This pattern of transmitting subset of waypoints 406 to the UAV while the UAV is completing a portion of the fli ght path 405 defined by the previous subset of waypoint can be continued until the UAV has completed the entire flight path 405. Figure 4F depicts a full flight path 405 and corresponding waypoint 406 for a UAV to fully fly through the search area boundary 403. All of the waypoints 406 have not been labeled for convenience.
After the flight path 405 has been determined, the UAV controller may update selections about the search. The UAV controller may change the selected search pattern, a track spacing of the search pattern, or other selections that may affect the flight path 405 of the search. In such a case, the control system can update the flight path and display the updated flight path overlayed on the map display.
Figure 6 depicts an example of a method 600 including steps of generating a search flight path for a UAV by a control system. At block 601, the control system can receive an indication of a search area from a UAV controller. As discussed above, the indication of the search area can be a drawing of a search area boundary on a map, an indication of a number of coordinates, an indication of a number of directions and lengths of sides of a search area boundary, and the like. At block 602, the control system can receive an indication of a search pattern. For example, a UAV controller can select one search pattern from a plurality of available search patterns. At block 603, the control system can determine a flight path based on the received search area boundary and the selected search pattern. The determined flight path can be represented by a plurality of waypoints. At block 604, the control system can transmit one or more indications of the flight path to the UAV. As discussed above, all of the one or more indications of the flight path can be transmitted to the UAV in a single transmission. Similarly, different indications of the flight path can be transmitted to the UAV in a single transmission can be transmitted to the UAV at different times. For example, one or more individual subsets of a plurality of waypoints can be transmitted the UAV while the UAV is flying along a portion of the flight path. At block, 605, the control system can display a map with an indication of the search area boundary and the flight path. If the flight path is updated, the control system can display the updated flight path.
In addition to displaying the map in block 605, the control system can also display search regions within the search area boundary. The size and number of the search regions be based on a number of factors. For example, the size and number of the search regions can be based on the size of the search area boundary. In another example the size and number of the search regions can be determined so as ίο cover the entire area bounded by the search area boundary. The determination of the search regions can include a determination of a search region shape. The search region shape can be any shape, such as a triangle, a rectangle, a square, a pentagon, a hexagon, and the like.
The method 600 depicted in Figure 6 can provide a number of benefits. For example, the method 600 can allow a control system to create a search flight path for a search area boundary based on two inputs by a UAV controller: an indication of the search area boundary and an indication of the selected search pattern. After entering those two inputs into a control system, the UAV controller can be free to focus attention to other aspects of controlling the UAV. Moreover, the control system can employ resources that may not be able to be employed by a controller. For example, the control system can employ an optimization function to minimize an amount of fuel used by the UAV to search the entire search area boundary. Other advantages are also possible.
Figure 7A depicts an example of a search flight path generated for UA.V to search a search area that includes a no-fly zone. Figure 7A depicts a topographical map 700 that includes an indication of a, body of water 701 and an indication of land 702. Figure 7 A. also depicts a search area boundary? 703 and search regions 704. Figure 7A further depicts a flight path 705. The flight path 705 can be defined by a plurality of waypoints 706, some of which are labeled as 706a, 706b, and 706c. Figure 7A also depicts a no-fly zone 707. The no-fly zone 707 can be an area where the UAV should not fly and/or is not permitted to fly. A number of factors may be used to determine whether a no-fly zone 707 is located in the search area boundary 703, For example, the land under the no-fly zone 707 may contain terrain that may make it difficult or dangerous for the UAV to fly, such as a mountain, a butte, a hill, tall buildings, and the like, in another example, the no-fly zone 707 may be located in restricted air space, such as airspace near an airport, airspace located near or in a militarized area, and the like.
As described above, a control system can determine the flight path 705 based on inputs of the search area boundary? 703 and a selected search pattern. The control system can also determine the flight path 705 such that the UAV will not enter the no-fly zone 707. The control system can define no-fly zones, such as no-fly zone 707, as a particular shape, such as a circular shape, a polygonal shape, a convex polygonal shape, and the like. The control system can take into account specifications of the UAV in determining the flight path 705 such that the UAV avoids the no-fly zone 707.
In one example, the control system can fake into account a minimum turn radius of a UAV when creating the flight path 705. Referring to Figure 7A, the waypoint 706b is not located in the search region immediately next to the no-fly zone 707. The location of waypoint 706b may be determined such that, based on the minimum turn rate of the UAV, the UA.V can fly from the waypoint 706b to the waypoint 706c without entering the no-fly zone 707. Figure 7B depicts a portion of the topographical map 700 showing a closer view of waypoints 706a-706c. In the flight path 705 between waypoint 706b and waypoint 706c, the flight path 705 makes several turns, keeping within the minimum turn rate of the UAV, to avoid the no-fly zone 707.
The control system can also determine the flight path 705 such that the UAV will pass near the edges of no-fly zone 70 7 a number of times or for a length of time such that a camera or sensor on the UAV can inspect some or all of the no-fly zone 707 without the UAV entering the airspace of the no-fly zone. Inspecting the no-fly zone 707 without the UAV entering the airspace of the ηο-fly zone can be accomplished with the aid of a camera and/or sensor mounted to a slewing mechanism on the UAV.
Figure 8 depicts a slewing mechanism 820 mounted to a UAV 810. The slewing mechanism can have mounted thereto one or more sensors 830. The one or more sensors 830 can include one or more imaging sensors, such as a camera, an infrared sensor, an electro-optical/infrared (EO/IR) camera, and the like. The one or more sensors 830 can also include one or more other types of sensors, such as an electromagnetic spectrum sensor, a gamma ray sensor, a biological sensor, a chemical sensor, and the like.
The slewing mechanism can be configured to rotate about one or more axes to position the one or more sensors 830 within a range of different angles. In the particular example shown in Figure 8, the slewing mechanism 820 can include a base portion 821 and an outer rotating portion 822. The outer rotating portion 822 can be configured to rotate with respect to the base portion 821 about an axis 823. The slewing mechanism can include a motor or actuator and a control unit to rotate the outer rotating portion 822 with respect to the base portion 821 about the axis 823 to particular angles. The slewing mechanism 820 can also include an inner rotating portion 824. The inner rotating portion 824 can be configured to rotate with respect to the outer rotating portion 822 about an axis 825. The slewing mechanism can include a motor or actuator and a control unit to rotate the inner rotating portion 824 with respect to the outer rotating portion 822 about the axis 825 to particular angles. The one or more sensors 830 can be mounted to the inner rotating portion 824. In this way, the one or more one or more sensors 830 can be directed in a wide range of directions.
As a UAV is flying along a search flight path, a control unit can be configured to direct the one or more sensors 830 to observe particular locations below the UAV. The control unit can control the movements of the slewing mechanism 820 to direct the one or more sensors 830 in appropriate directions to observe the particular locations. The control unit can include one or more algorithms the intelligently and autonomously direct the one or more sensors 830 to observe particular locations.
One example of an algorithm for directing the one or more sensors 830 to observe particular locations is a route scan algorithm. A route scan algorithm observes locations along and near the route of the UAV. For example, while a UAV is flying over a particular search region, the control unit can direct the one or more sensors 830 to observe the search region directly under the UAV. Observing the search region directly under the UAV can include moving the directing the one or more sensors 830 to the right and left of the UAV in order to observe an entire search region along the route. In another example, the algorithm can take into ac count vehicle geometry (such as locations of propellers, direction, of travel, and the like) when directing the one or more sensors 830.
Another example of an algorithm for directing the one or more sensors 830 to observe particular locations is an optimization algorithm. An optimization algorithm may determine to direct the one or more sensors 830 to a portion of a search area based on a potential benefit of searching that portion of the search area. It may be determined that such an area is relatively close to the UAV or relatively far from the UAV. The determination of an area to search can be based on a probability that a search target is or is not located within a particular search region. Such a probability can be determined based on a target probability map, as discussed below with respect to Figure 9. The determination of an area to search can also be based on the geometry of the UA V and the location of the slewing mechanism 820. For example, if a camera was directed directly toward a propeller of the UAV, the resulting image may be an image of the propeller which would not be useful in a search of the area. Taking into account the geometry of the UA V can prevent wasted search time. The slewing mechanism may also have a limited range of motion and may not be able to direct the camera in particular directions. Taking into account any geometric limi tations of the slewing mechanism can prevent attempt to direct the sensors in a direction that the slewing mechanism cannot turn. The determination of an area to search can also be based on the existence of a no-fly zone. For example, it may be advantageous to direct a sensor to search a search region under a no-fly zone any time that the UAV is located near the edges of a no-fly zone. The determination of an area to search can also be based on the existence of a no-look zone, A no-look zone may be a zone where sensitive operations occur at particular times, such as exercises occurring on a military base, during which images should not be taken. Taking into account a no-look zone can prevent an unauthorized party from intercepting images of sensitive operations transmitted from a UAV to a control system. The determination of an area to search can also be based on image quality considerations. For example frequent and/or fast movements of the slewing mechanism may cause jitter in the images and/or video taken by the camera and sent back to the control system, and make it difficult for a user to view the images and/or video taken by the camera. Similarly, frequent zooming of the camera can make it difficult for a user to view images and/or video taken by the camera.
Regardless of the algorithm used to direct the one or more sensors 830, after the one or more sensors 830 complete an observation of a particular location, a new? observation location can be selected using the algorithm. The control unit that controls the direction of the one or more sensors 830 can be located in either a ground-based control system used by UAV controller or onboard a UAV itself. In either case, the control unit can control the one or more sensors 830 during the search, freeing the UAV controller to focus on other aspects of controlling the UAV and/or interpreting the results of the search.
The one or more sensors 830 can include a camera and a sensor. The sensor can be configured to determine where the camera should be directed and an appropriate zoom for the camera. The camera can be configured to focus on and take images of the search regions, in one example, the sensor can be configured to identify a portion of a search region before the camera is rotated toward and focused on the portion of the search region. The sensor can obtain information such as an orientation and a distance to the portion of the search region, and the con trol of the slewing mechanism 820 and the camera can be based on the information obtained by the sensor. In this way, the sensor can be detecting potential target search regions ahead of the time that the camera is taking images of the search regions. A control unit of the slewing mechanism can be configured to receive the sensor signals and control the slew?ing mechanism based on the sensor signals.
While a UAV is performing a search, a target probability map can be created. A target probability map can include a number of search regions and an indication of a probability whether a search target is or is not located in each of the search regions. Figure 9 depicts an example of a target probability map 900. The target probability map includes a number of hexagonal-shaped search regions 901-920. While the search regions 901-920 depicted in the target probability map 900 of Figure 9 happen to be in the shape of hexagons, search regions in a target probability map can be of any shape or size. Each of the search regions 901-920 can include one or more indications of a probability that the target is not loca ted in that particular search region. For example, the search regions 901-920 have various levels of shading: search region 919 has no shading; search regions 908, 913, 916, and 918 have the lightest form of shading; search regions 912, 914, 915, and 917 have the next darker level of shading; search regions 903, 905, 907, 909, and 920 have the next darker level of shading; search regions 904, 906, 910, and 911 have the next darker level of shading; and search regions 901 and 902 have the darkest level of shading. The darker the level of shading of a search region can indicate the greater the likelihood that the search target is not located in that search region. For example, the darkest level of shading in search regions 901 and 902 can indicate a high likelihood that the search target is not located in search regions 901 and 902.
Variations of the target probability map 900 depicted in Figure 9 are possible. For example, while the indications of probability in target probability map 900 are shown in terms of shading, other indicators of probability could be used. Probabilities in a target probability map could be indicated using a variety of colors (e.g., a heat map), numerical indications of percen tages, and the like. In another example, the target probability map 900 could be overlayed on a depiction of a search area, such as a map of the search area, an overhead view of the search area, and the like. If the target probability map 900 is overlayed on a map of a search area and dar ker shading in the search regions indicates less of a likelihood that the search target is in the area, then the shading will tend to obscure those portions of the map that are less likely to contain the search target and then shading will tend to leave exposed those portions of the map that are more likely to contain the search target.
The probability that a search target is located in a particular search region can be based on one or more of a number of factors. One probability factor can be the number of times that a UAV has flown over the search area. For example, in the case of the flight path 405 depicted in Figure 4F, the flight path 405 would take the UAV over the right side of the search area boundary 403 many times. Likewise, the flight path 405 would take the UAV over the top side of the search area boundary 403 many times. While the UAV flies over the search regions on the right and tops sides of search area boundary 403 many times, it can conduct further searches of those areas. The probability that the search target is located in the search regions on the right and top sides of the search area boundary 403 could be lower after being searched many times than in the search regions in the center of the search area bound ary 403, along the lower side of search area boundary 403, and along the bottom side of the search area boundary 403.
Another probability factor can be based on information about the terrain in the search area. For example, if the terrain in a search region limits visibility......such as in the case of an area with many trees and/or tall buildings—a search of the search region may not substantially reduce the probability that the search target is not in the search area. Conversely, if a search region has terrain with no visibility issues—such as a body of calm water, a beach area, and the like—a search of the search region may substantially reduce the probability that the search target is not in the search area. Other terrain issues, such as a steepness of the terrain, the color of the terrain, and any other condition of the terrain, can be taken into account.
Another probability factor can be based on information about conditions in the search region at the time that a search was conducted. For example, if a search region was searched on a cloudless day with no wind, the probability that a search target would be in the search region after a search may be lower. In another example, if a search region was searched at a time of limited visibility—such as when clouds or fog were present, when snow was on the ground, and the like—the probability that a search target would be in the search region after a search may be higher. Any other information about the conditions of a search region at the time that a search was conducted can be taken into account.
Another probability factor can be based on information about the search target itself. For example, if the search target is mobi le.......such as in the case of a lost hiker or lifeboat on a body of water—the search target may move into a search region that was previously searched. Thus, the probability that the search target in not located in a particular search region can decrease with time from the last search of the search region. Conversely, if the search target is not mobi le—such as in th e case of wreckage of a crashed aircraft or a disabled land vehicle— the probability that the search target in not located in a particular search region may not change with time from the last search of the search region . In another example, if a search target is likely to seek shelter-—such as in the case of a lost hiker or injured animal—the search of a search region with many locations for shelter may not substantially reduce the probability that the search target is located within a particular search area.
When a target probability map is created, it can be used in a number of ways. For example, a UAV controller may use a target probability map to redraw a search area boundary. Referring back to Figure 4F, after the UA V completes the flight path 405, each of the search regions 404 could indicate a probability (e.g., by being shaded) to form a target probability map. For example, since the flight path 405 follows along the right side and top side of the search boundary area 403 a number of times, the search regions 404 can show a higher probability that the search target is not located along the right and top sides of the search area boundary 403. Similarly, others of the search regions 404, such as those near the bottom side and left side of the search area boundary? 403, can show a lower probability that the search target is not located along the left and bottom sides of the search area boundary 403. In this case, the UAV controller can draw? a new? area boundary map that does not include all of the search regions along the right and top sides of the search area boundary 403. In another example, a control system can use the target probability map to determine a flight path for a search. Referring again to Figure 4F, once a UAV has completed a search by flying along the flight path 405, a control system can determine a new flight path for a second search. The control system can determine to start the new? flight path in a different location (e.g., closer to the lower left hand corner of the search area boundary 403) so that the search occurs where the target probability map indicates a lower likelihood that the search target is not in the search region where the new flight path will start. FIG. 10 and the following discussion are intended to provide a brief general description of a suitable computing environment in which the methods and systems disclosed herein and/or portions thereof may be implemented. For example, the functions of server 304, laptop 306, desktop 308, flight planning system 302, and database 326 may be performed by one or more devices that include some or all of the aspects described in regard to FIG. 10. Some or all of the devices described in FIG. 10 that may be used to perform functions of the claimed examples may be configured in other devices and systems such as those described herein. Alternatively, some or all of the devices described in FIG. 10 may be included in any device, combination of devices, or any system that performs any aspect of a disclosed example.
Although not required, the methods and systems disclosed herein may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer, such as a client workstation, server or personal computer. Such computer-executable instructions may be stored on any type of computer-readable storage device that is not a transient signal per se. Generally, program modules include routines, programs, objects, components, data structures and the like that perform particular tasks or implement particular abstract data types. Moreover, it should be appreciated that the methods and systems disclosed herein and/or portions thereof may be practiced with other computer system configurations, including hand-held devices, multi-processor systems, microprocessor-based or programmable consumer electronics, network PCs, minicomputers, mainframe computers and the like. The methods and systems disclosed herein may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network, in a distributed computing environment, program modules may be located in both local and remote memory storage devices. FIG. 10 is a block diagram representing a general purpose computer system in which aspects of the methods and systems disclosed herein and/or portions thereof may be incorporated. As shown, the exemplary general purpose computing system includes computer 1020 or the like, including processing unit 1021, system memory 1022, and system bus 1023 that couples various system components including the system memory to processing unit 1021. System bus 1023 may be any of several types of bus structures including a memory bus or memory/ controller, a peripheral bus, and a local bus using any of a variety of bus architectures. The system memory may include read-only memory (ROM) 1024 and random access memory (RAM) 1025. Basic input/output system 1026 (BIOS), which may contain the basic routines that help to transfer information between elements within computer 1020, such as during start-up, may/ be stored in ROM 1024.
Computer 1020 may further include hard disk drive 1027 for reading from and writing to a hard disk (not shown), magnetic disk drive 1028 for reading from or writing to removable magnetic disk 1029, and/or optical disk drive 1030 for reading from or writing to removable optical disk 1031 such as a CD-ROM or other optical media. Hard disk drive 1027, magnetic disk drive 1028, and optical disk drive 1030 may be connected to system bus 1023 by hard disk drive interface 1032, magnetic disk drive interface 1033, and optical drive interface 1034, respectively. The drives and their associated computer-readable media provide non-volatile storage of computer-readable instructions, data structures, program modules and other data for computer 1020.
Although the example environment described herein employs a hard disk, removable magnetic disk 1029, and removable optical disk 1031, it should be appreciated that other types of computer-readable media that can store data that is accessible by a computer may also be used in the exemplary/ operating environment. Such other types of media include, but are not limited to, a magnetic cassette, a flash memory card, a digital video or versatile disk, a Bernoulli cartridge, a random access memory (RAM), a read-only memory (ROM), and the like. A number of program modules may be stored on hard disk drive 1027, magnetic disk 1029, optical disk 1031, ROM 1024, and/or RAM 1025, including an operating system 1035, one or more application programs 1036, other program modules 1037 and program data 1038. A user may enter commands and information into the computer 1020 through input devices such as a keyboard 1040 and pointing device 1042. Other input devices (not shown) may include a microphone, joystick, game pad, satellite disk, scanner, or the like. These and other input devices are often connected to the processing unit 1021 through a serial port interface 1046 that is coupled to the system bus, but may be connected by other interfaces, such as a parallel port, game port, or universal serial bus (USB). A monitor 1047 or other type of display device may also be connected to the system bus 1023 via an interface, such as a video adapter 448. In addition to the monitor 1047, a computer may include other peripheral output devices (not shown), such as speakers and printers. The exemplary system of FIG. 10 may also include host adapter 1055, Small Computer System Interface (SCSI) bus 1056, and external storage device 1062 that may be connected to the SCSI bus 1056.
The computer 1020 may operate in a networked environment using logical and/or physical connections to one or more remote computers or devices, such as remote computer 1049, that may represent any of server 304, laptop 306, desktop 308, flight planning system 302, and database 326. Each of server 304, laptop 306, desktop 308, flight planning system 302, and database 326 may be any device as described herein capable of performing the determination and display of zero fuel time data and return to base time data. Remote computer 1049 may be a personal computer, a server, a router, a network PC, a peer device or other common network node, and may include many or all of the elements described above relative to the computer 1020, although only a memory storage device 1050 has been illustrated in FIG. 10. The logical connections depicted in FIG. 10 may include local area network (LAN) 1051 and wide area network (WAN) 1052. Such networking environments are commonplace in police and military facilities, offices, enterprise-wide computer networks, intranets, and the Internet.
When used in a LAN networking environment, computer 1020 may be connected to LAN 1051 through network interface or adapter 1053. When used in a WAN networking environment, computer 1020 may include modem 1054 or other means for establishing communications over wide area network 1052, such as the Internet. Modem 1054, which may be internal or external, may be connected to system bus 1023 via serial port interface 1046. In a networked environment, program modules depicted relative to computer 1020, or portions thereof, may be stored in a remote memory storage device. It will be appreciated that the network connections shown are exemplary and other means of establishing a communications link between computers may be used.
Computer 1020 may include a variety of computer-readable storage media. Computer-readable storage media can be any available tangible, non-transitory, or non-propagating media that can be accessed by computer 1020 and includes both volatile and nonvolatile media, removable and non-removable media. By way of example, and not limitation, computer-readable media may comprise computer storage media and communication media. Computer storage media include volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules or other data. Computer storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory? or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other tangible medium that can be used to store the desired information and that can be accessed by computer 1020. Combinations of any of the above should also be included within the scope of computer-readable media that may be used to store source code for implementing the methods and systems described herein. Any combination of the features or elemen ts disclosed herein may be used in one or more examples.
Conditional language used herein, such as, among others, "can," "could," "might," "may," "e.g.," and the like, unless specifically stated otherwise, or otherwise understood within the context as used, is generally intended to convey that certain examples include, while other examples do not include, certain features, elements, and/or steps. Thus, such conditional language is not generally intended to imply that features, elements and/or steps are in any way required for one or more examples or that one or more examples necessarily? include logic for deciding, with or without author input or prompting, whether these features, elements and/or steps are included or are ίο be performed in any particular example. The terms "comprising," "including," "having," and the like are synonymous and are used inclusively, in an open-ended fashion, and do not exclude additional elements, features, acts, operations, and so forth. Also, the term "or" is used in its inclusive sense (and not in its exclusive sense) so that when used, for example, to connect a list of elements, the term "or" means one, some, or all of the elements in the list.
In general, the various features and processes described above may be used independently of one another, or may be combined in different ways. All possible combinations and subcombinations are intended to fall within the scope of this disclosure. In addition, certain method or process blocks may be omitted in some implementations. The methods and processes described herein are also not limited to any particular sequence, and the blocks or states relating thereto can be performed in other sequences that are appropriate. For example, described blocks or states may be performed in an order other than that specifically disclosed, or multiple blocks or states may be combined in a single block or state. The example blocks or states may be performed in serial, in parallel, or in some other manner. Blocks or states may be added to or removed from the disclosed examples. The example systems and components described herein may be configured differently than described. For example, elements may be added to, removed from, or rearranged compared to the disclosed examples.
Further, the disclosure comprises embodiments according to the following clauses:
Clause 1. A system for displaying target search probabilities, the system comprising: a control unit configured to determine, based on an optimization algorithm, a search area to be searched; a sensor mounted on an air vehicle, the sensor configured to determine a direction and a distance to the search area; and a camera mounted on the air vehicle, the camera configured to take one or more images of the search area; wherein the control unit is further configured to: recei ve, from the sensor, an indication of the direction and the distance to the search area, and control an orientation and a zoom of the camera based on the indication of the direction and the distance to the search area received from the sensor.
Clause 2. The system of Clause 1, further comprising: a display configured to display a plurality of search regions and to display, in one or more of the plurality of search regions, an indication of a likelihood that a search target is located in each of the one or more of the plurality of search regions.
Clause 3. The system of Clause 2, wherein the indication of the likelihood that the search target is located in each of the one or more of the plurality of search regions comprises one or more of a shading of the one or more of the plurali ty of search regions, a color of the one or more of the plurality of search regions, and a numerical indicator in the one or more of the plurality of search regions.
Clause 4. The system of Clause 2, wherein the likelihood that the search target is located in each of the one or more of the plurality of search regions is calculated based on one or more of information about terrain of the one or more of the plurality of search regions, information about conditions during a search of the one or more of the plurality of search regions, and information about the search target.
Clause 5. A method of planning a flight path for a search, the method comprising: receiving, by a control system, an indication of a search area boundary; receiving, by the control system, an indication of a selected search pattern; identifying a no-fly zone, wherein at least a portion of the no-fly zone overlaps at least a portion of the search area boundary; determining, by the control system, a flight path based on the search area boundary, the selected search pattern, the no-fly zone, and at least one specification of an unmanned aerial vehicle; and transmitting one or more indications of the flight path to the unmanned aerial vehicle.
Clause 6. The method of Clause 5, further comprising: displaying the flight path on a display of a map.
Clause 7. The method of Clause 5, wherein the no-fly zone is defined as a polygon.
Clause 8. The method of Clause 5, wherein the flight path is determined such that the unmanned aerial vehicle searches portions of the search area boundary that are outside of the no-fly zone.
Clause 9. The method of Clause 5, wherein the specification of the unmanned aerial vehicle comprises a minimum turn radius.
Clause 10. The method of Clause 5, wherein the control system is configured to automatically determine the flight path.
Clause 11. The method of Clause 10, wherein the control system is further configured to automatically determine the flight path at least partially simultaneously while a controller of the unmanned aerial vehicle is controlling another aspect of the unmanned aerial vehicle.
Clause 12, A system comprising: an unmanned aerial vehicle configured to fly over one of a plurality of search areas; a slewing mechanism mounted on the unmanned aerial vehicle; a control unit configured determine one search area from the plurality of search areas to be searched based on an optimization algorithm and to control the slewing mechanism based on the determination of the one search area to be searched; and a camera mounted on the slewing mechanism, wherein the camera is configured to take one or more images of the one search area to be searched.
Clause 13. The system of Clause 12, wherein the control unit is further configured to determine the one search area based on a location of th e unmanned aerial vehicle.
Clause 14. The system of Clause 12, wherein the control unit is further configured to determine the one search area based on a location of a no-fly zone with respect to the unmanned aerial vehicle.
Clause 15. The system of Clause 12, wherein the control unit is further configured to determine the one search area based on at least one specification of an unmanned aerial vehicle.
While certain example or illustrative examples have been described, these examples have been presented by way of example only, and are not intended to limit the scope of the inventions disclosed herein. Indeed, the novel methods and systems described herein may be embodied in a variety of other forms. The accompanying claims and their equivalents are intended to cover such forms or modifications as would fall within the scope of the inventions disclosed herein.
1. A method of planning a flight path for a search, the method comprising: receiving, by a control system, an indication of a search area boundary; receiving, by the control system, an indication of a selected search pattern; determining, by the control system, the flight path based on the search area boundary, the selected search pattern, and an optimization algorithm, the optimization algorithm configured to direct the search to search regions within the search area boundary based on a likelihood that a search target is located within the search regions, wherein the likelihood is based on a number of times the search has been performed in the search regions and terrain of the search regions; and transmitting one or more indications of the flight path to an unmanned aerial vehicle.
2. The method of claim 1, wherein the selected search pattern comprises at least one of a trackline search pattern, a parallel search pattern, a creeping line search pattern, an expanding square search pattern, and a sector search pattern.
3. The method of claim 1, further comprising: receiving a pattern direction; wherein determining the flight path comprises determining the flight path based further on the pattern direction.
4. The method of claim 1, further comprising: displaying the flight path on a display of a map.
5. The method of claim 4, further comprising: receiving, by the control system, an update of one or more of the selected search pattern or track spacing of the selected search pattern; and updating the displayed flight path on the display of the map.
6. A system for displaying target search probabilities, the system comprising: a control unit configured to determine, based on an optimization algorithm, a search area to be searched, the optimization algorithm configured to direct a search to search regions within a search area boundary based on a likelihood that a search target is located within the search regions, wherein the likelihood is based on a number of times the search has been performed in the search regions and terrain of the search regions; a sensor mounted on an air vehicle, the sensor configured to determine a direction and a distance to the search area; and a camera mounted on the air vehicle, the camera configured to take one or more images of the search area; wherein the control unit is further configured to: receive, from the sensor, an indication of the direction and the distance to the search area, and control an orientation and a zoom of the camera based on the indication of the direction and the distance to the search area received from the sensor.
7. The system of claim 6, further comprising: a display configured to display the search regions and to display, in one or more of the search regions, an indication of the likelihood that the search target is located in each of the one or more of the search regions.
8. The system of claim 7, wherein the indication of the likelihood that the search target is located in each of the search regions comprises one or more of a shading of the one or more of the search regions, a color of the one or more of the search regions, and a numerical indicator in the one or more of the search regions.
9. A method of planning a flight path for a search, the method comprising: receiving, by a control system, an indication of a search area boundary; receiving, by the control system, an indication of a selected search pattern; identifying a no-fly zone, wherein at least a portion of the no-fly zone overlaps at least a portion of the search area boundary; determining, by the control system, the flight path based on the search area boundary, the selected search pattern, the no-fly zone, an optimization algorithm, and at least one specification of an unmanned aerial vehicle, the optimization algorithm configured to direct the search to search regions within the search area boundary based on a likelihood that a search target is located within the search regions, wherein the likelihood is based on a number of times the search has been performed in the search regions and terrain of the search regions; and transmitting one or more indications of the flight path to the unmanned aerial vehicle.
10. The method of claim 9, further comprising: displaying the flight path on a display of a map.
11. The method of claim 9, wherein the no-fly zone is defined as a polygon.
12. The method of claim 9, wherein the flight path is determined such that the unmanned aerial vehicle searches portions of the search area boundary that are outside of the no-fly zone.
13. The method of claim 9, wherein the specification of the unmanned aerial vehicle comprises a minimum turn radius.
14. The method of claim 9, wherein the control system is configured to automatically determine the flight path.
15. The method of claim 14, wherein the control system is further configured to automatically determine the flight path at least partially simultaneously while a controller of the unmanned aerial vehicle is controlling another aspect of the unmanned aerial vehicle.
16. A system comprising: an unmanned aerial vehicle configured to fly over one of a plurality of search areas; a slewing mechanism mounted on the unmanned aerial vehicle; a control unit configured to determine one search area from the plurality of search areas to be searched based on an optimization algorithm and to control the slewing mechanism based on the determination of the one search area to be searched, the optimization algorithm configured to a search to search regions within a search area boundary based on a likelihood that a search target is located within the search regions, wherein the likelihood is based on a number of times the search has been performed in the search regions and terrain of the search regions; and a camera mounted on the slewing mechanism, wherein the camera is configured to take one or more images of the one search area to be searched.
17. The system of claim 16, wherein the control unit is further configured to determine the one search area based on a location of the unmanned aerial vehicle.
18. The system of claim 16, wherein the control unit is further configured to determine the one search area based on a location of a no-fly zone with respect to the unmanned aerial vehicle.
19. The system of claim 16, wherein the control unit is further configured to determine the one search area based on at least one specification of the unmanned aerial vehicle.
AU2014349144A 2013-08-30 2014-08-29 Unmanned vehicle searches Active AU2014349144B2 (en)
US14/453,406 US9824596B2 (en) 2013-08-30 2014-08-06 Unmanned vehicle searches
PCT/US2014/053365 WO2015073103A2 (en) 2013-08-30 2014-08-29 Unmanned vehicle searches
AU2014349144A1 AU2014349144A1 (en) 2016-02-18
AU2014349144B2 true AU2014349144B2 (en) 2018-08-02
AU2014349144A Active AU2014349144B2 (en) 2013-08-30 2014-08-29 Unmanned vehicle searches
US9629220B2 (en) * 2013-08-05 2017-04-18 Peter Panopoulos Sensor-based controllable LED lighting system with repositionable components and method
US9933782B2 (en) * 2013-10-23 2018-04-03 Sikorsky Aircraft Corporation Locational and directional sensor control for search
US10051178B2 (en) 2013-12-06 2018-08-14 Bae Systems Plc Imaging method and appartus
US10203691B2 (en) * 2013-12-06 2019-02-12 Bae Systems Plc Imaging method and apparatus
US9798324B2 (en) 2014-07-18 2017-10-24 Helico Aerospace Industries Sia Autonomous vehicle operation
CN105745587B (en) * 2014-07-31 2018-09-21 深圳市大疆创新科技有限公司 The virtual tours system and method realized using unmanned vehicle
US9618934B2 (en) * 2014-09-12 2017-04-11 4D Tech Solutions, Inc. Unmanned aerial vehicle 3D mapping system
US9655034B2 (en) 2014-10-31 2017-05-16 At&T Intellectual Property I, L.P. Transaction sensitive access network discovery and selection
US9629076B2 (en) 2014-11-20 2017-04-18 At&T Intellectual Property I, L.P. Network edge based access network discovery and selection
US9752878B2 (en) * 2014-12-09 2017-09-05 Sikorsky Aircraft Corporation Unmanned aerial vehicle control handover planning
US20160173740A1 (en) * 2014-12-12 2016-06-16 Cox Automotive, Inc. Systems and methods for automatic vehicle imaging
US20160307447A1 (en) * 2015-02-13 2016-10-20 Unmanned Innovation, Inc. Unmanned aerial vehicle remote flight planning system
EP3254404A4 (en) 2015-03-31 2018-12-05 SZ DJI Technology Co., Ltd. Authentication systems and methods for generating flight regulations
JP2018511245A (en) * 2015-03-31 2018-04-19 エスゼット ディージェイアイ テクノロジー カンパニー リミテッドSz Dji Technology Co.,Ltd UAV load control system
CN104807457A (en) * 2015-04-29 2015-07-29 广州快飞计算机科技有限公司 Generation method and device of flight line of aircraft and terminal equipment
CN104932516A (en) * 2015-05-08 2015-09-23 叶春林 Unmanned plane safety control system and method
US10162351B2 (en) * 2015-06-05 2018-12-25 At&T Intellectual Property I, L.P. Remote provisioning of a drone resource
US10129706B2 (en) 2015-06-05 2018-11-13 At&T Intellectual Property I, L.P. Context sensitive communication augmentation
US9678507B1 (en) * 2015-06-25 2017-06-13 Latitude Engineering, LLC Autonomous infrastructure element survey systems and methods using UAV fleet deployment
US20170088261A1 (en) * 2015-09-29 2017-03-30 Tyco Fire & Security Gmbh Search and Rescue UAV System and Method
US10505622B1 (en) * 2015-10-05 2019-12-10 5X5 Technologies, Inc. Methods of operating one or more unmanned aerial vehicles within an airspace
JP6357176B2 (en) * 2016-01-12 2018-07-11 株式会社Subaru Moving path setting device, moving path setting method, and moving path setting program
JP6200539B1 (en) * 2016-03-24 2017-09-20 株式会社Subaru Reconnaissance position calculation device, reconnaissance position calculation method, and reconnaissance position calculation program
US9984578B2 (en) * 2016-05-03 2018-05-29 Rockwell Collins, Inc. Digital map enabled boundary search pattern
US20170334559A1 (en) * 2016-05-20 2017-11-23 Unmanned Innovation, Inc. Unmanned aerial vehicle area surveying
WO2017216972A1 (en) * 2016-06-17 2017-12-21 楽天株式会社 Unmanned aircraft control system, unmanned aircraft control method, and program
WO2018032420A1 (en) * 2016-08-17 2018-02-22 张琬彬 Method and system for adjusting flight altitude according to wind force value
EP3287748A1 (en) * 2016-08-22 2018-02-28 Deutsche Telekom AG An operation-aware aerial navigation system
US10470241B2 (en) 2016-11-15 2019-11-05 At&T Intellectual Property I, L.P. Multiple mesh drone communication
CN106679666B (en) * 2016-12-26 2019-12-17 北京联合大学 Unmanned aerial vehicle large-range cruise path planning model and method
US10037704B1 (en) * 2017-02-01 2018-07-31 David Myr Automatic real-time air traffic control system and method for maximizing landings / takeoffs capacity of the airport and minimizing aircrafts landing times
FR3063819B1 (en) * 2017-03-09 2019-04-12 Dassault Aviat Aircraft track implementation assembly and method thereof
US10431101B2 (en) 2017-05-22 2019-10-01 Honeywell International Inc. System and method for customizing a search and rescue pattern for an aircraft
CN107270910A (en) * 2017-06-13 2017-10-20 南宁市勘察测绘地理信息院 Single-lens oblique photograph boat flies line design method, system and method for imaging of taking photo by plane
FR3070787A1 (en) * 2017-09-05 2019-03-08 Thales Sa Method and system for preparing the flight of a drone
US20190228573A1 (en) * 2018-01-25 2019-07-25 General Electric Company Automated and adaptive three-dimensional robotic site surveying
FR3079296A1 (en) * 2018-03-22 2019-09-27 Thales Method and system for assisting an operator to develop a flight plan of an aircraft through a set of mission zones to be covered
US20090157233A1 (en) * 2007-12-14 2009-06-18 Kokkeby Kristen L System and methods for autonomous tracking and surveillance
US5911775A (en) * 1996-10-08 1999-06-15 Alpine Electronics, Inc. Return point route searching for vehicle navigation
US7343232B2 (en) 2003-06-20 2008-03-11 Geneva Aerospace Vehicle control system including related methods and components
US7908040B2 (en) * 2004-07-15 2011-03-15 Raytheon Company System and method for automated search by distributed elements
US8370057B1 (en) 2007-07-31 2013-02-05 Stanley Robert Herwitz Audiovisual display modes for sense-and-avoid system for aerial vehicles
US7876258B2 (en) * 2006-03-13 2011-01-25 The Boeing Company Aircraft collision sense and avoidance system and method
JP2007314129A (en) * 2006-05-29 2007-12-06 Fujitsu Ten Ltd Parking support device
DE102007032084A1 (en) * 2007-07-09 2009-01-22 Eads Deutschland Gmbh Collision and Conflict Prevention System for autonomous unmanned aerial vehicles (UAV)
US8082102B2 (en) * 2008-01-14 2011-12-20 The Boeing Company Computing flight plans for UAVs while routing around obstacles having spatial and temporal dimensions
US8387911B2 (en) * 2008-07-25 2013-03-05 Honeywell International Inc. Ducted fan core for use with an unmanned aerial vehicle
US8521339B2 (en) * 2008-09-09 2013-08-27 Aeryon Labs Inc. Method and system for directing unmanned vehicles
US8626361B2 (en) * 2008-11-25 2014-01-07 Honeywell International Inc. System and methods for unmanned aerial vehicle navigation
IT1394782B1 (en) * 2009-03-03 2012-07-13 Alenia Aeronautica Spa Prediction Method of collisions between an aircraft and an aircraft
US8368584B2 (en) * 2009-06-10 2013-02-05 The University Of North Dakota Airspace risk mitigation system
US8594932B2 (en) * 2010-09-14 2013-11-26 The Boeing Company Management system for unmanned aerial vehicles
US8874360B2 (en) * 2012-03-09 2014-10-28 Proxy Technologies Inc. Autonomous vehicle and method for coordinating the paths of multiple autonomous vehicles
IL230327A (en) * 2014-01-01 2019-11-28 Israel Aerospace Ind Ltd Interception missile and warhead therefor
US20160272333A1 (en) * 2014-03-31 2016-09-22 Sharper Shape Oy Autonomous airbag system for unmanned aerial vehicles
US10142609B2 (en) * 2015-04-29 2018-11-27 Northrop Grumman Systems Corporation Dynamically adjustable situational awareness interface for control of unmanned vehicles
US20170146990A1 (en) * 2015-11-19 2017-05-25 Caterpillar Inc. Augmented communication and positioning using unmanned aerial vehicles
Huang et al. 2017 Visual odometry and mapping for autonomous flight using an RGB-D camera
Elfes et al. 1998 A semi-autonomous robotic airship for environmental monitoring missions
Gonzalez et al. 2016 Unmanned aerial vehicles (UAVs) and artificial intelligence revolutionizing wildlife monitoring and conservation
JP6133506B2 (en) 2017-05-24 Flight control for flight restricted areas
US8626361B2 (en) 2014-01-07 System and methods for unmanned aerial vehicle navigation
Bachrach et al. 2011 RANGE–Robust autonomous navigation in GPS‐denied environments
EP2685336A1 (en) 2014-01-15 Autonomous airspace flight planning and virtual airspace containment system
US10038492B2 (en) 2018-07-31 Method, apparatus and system of providing communication coverage to an unmanned aerial vehicle
US10453348B2 (en) 2019-10-22 Unmanned aerial vehicle management
US9513635B1 (en) 2016-12-06 Unmanned aerial vehicle inspection system
US20120261144A1 (en) 2012-10-18 Fire Management System
JP2015006874A (en) 2015-01-15 Systems and methods for autonomous landing using three dimensional evidence grid
US10185321B2 (en) 2019-01-22 Unmanned vehicle, system and method for determining a planned path for unmanned vehicles
US10162353B2 (en) 2018-12-25 Scanning environments and tracking unmanned aerial vehicles
US10061328B2 (en) 2018-08-28 Autonomous landing and control
Máthé et al. 2015 Vision and control for UAVs: A survey of general methods and of inexpensive platforms for infrastructure inspection
US9915946B2 (en) 2018-03-13 Unmanned aerial vehicle rooftop inspection system
Bircher et al. 2016 Three-dimensional coverage path planning via viewpoint resampling and tour optimization for aerial robots
Barrientos et al. 2011 Aerial remote sensing in agriculture: A practical approach to area coverage and path planning for fleets of mini aerial robots
Kendoul 2012 Survey of advances in guidance, navigation, and control of unmanned rotorcraft systems
US10216197B2 (en) 2019-02-26 Vehicle altitude restrictions and control
US9835453B2 (en) 2017-12-05 Ground control point assignment and determination system
Saska et al. 2017 System for deployment of groups of unmanned micro aerial vehicles in GPS-denied environments using onboard visual relative localization
JP2017508166A (en) 2017-03-23 Sensor fusion
WO2016130994A1 (en) 2016-08-18 Unmanned aerial vehicle remote flight planning system
2017-10-05 HB Alteration of name in register
Owner name: UNIVERSITY OF WASHINGTON
Free format text: FORMER NAME(S): UNIVERSITY OF WASHINGTON; INSITU, INC. (A SUBSIDIARY OF THE BOEING COMPANY)
Owner name: INSITU, INC.
2018-11-29 FGA Letters patent sealed or granted (standard patent)