Words? |? James
WWDC, the annual Apple Global Developers Conference, will be officially held tomorrow morning. Recently, a lot of new news broke out in Apple's software and hardware products.
The same is true of Apple's Titan car project, which has remained mysterious.
At the end of May, it was reported that Apple will invest 654.38+0.9 billion US dollars (about 654.38+0.33 billion RMB) in R&D this year for automobile projects. We should know that the annual R&D expenditure of the global automobile industry is $80 billion to $654.38+000 billion (about 560 billion to 700 billion RMB), and Apple alone accounts for one fifth.
In addition, Apple has recently obtained a number of patents on autonomous driving, which has continuously enriched Apple's automobile patents. According to the incomplete statistics of cars and things, Apple has obtained nearly 70 automobile patents since 20 17 years, and at least 16 automobile patents in the first half of this year. Moreover, it can be said that it covers all aspects of car-making in terms of autonomous driving, electric vehicles, in-vehicle software, body and security.
▲ Apple won the automobile patent this year.
So what is Apple doing in the automotive field? What are Apple's ideas and designs? What changes will it bring to the automobile industry?
The matter of the car is found in the new patents obtained by Apple this year. Some patents obtained by Apple are about autonomous driving and electric vehicles, as well as body structures such as doors and suspensions. The largest number is the in-car experience patent. This year, * * * won 7 items, accounting for nearly half. At the same time, many patents obtained by Apple this year are the updating iterations of previous patents (please refer to the previous article "Apple's heart of making cars is not dead! 1 year, 30 patents have been added, all of which are black technologies.
This shows that Apple is bent on building an electric car that can drive automatically, with intelligent software and hardware interaction experience, and also with high safety and comfortable driving experience. From the patent point of view, Apple's car is very purposeful, not imaginative.
1. Does Apple invest 654.38+03 billion yuan to develop cars every year? Obtained nearly 70 patents
Recently, research institute Morgan Stanley released an investor report, and senior analyst Katie? Huberty said in the report that Tesla and Apple, two technology giants, are unlikely to become partners now, but are likely to become competitors. In addition, the report also predicts the future development route of Apple's automobile project.
Katie. Huberty predicts that Apple will invest $654.38+0.9 billion (RMB 654.38+0.33 billion) in R&D this year for automobile projects.
Let's make a comparison here. The annual R&D expenditure of the global automobile industry is between 80 ~1000 billion US dollars (about 560 ~ 700 billion yuan), and Apple's R&D expenditure this year is equivalent to 20% ~ 25% of the entire automobile industry.
In addition, compared with five years ago, Apple's R&D expenditure on automobile projects has increased by more than $654.38 billion. In other words, Apple's investment in automobile projects has doubled in five years.
Katie. Huberty believes that Apple's car project will not be limited to the "advanced version of CarPlay", but oriented to a larger platform, so that Apple can achieve more flexible control in hardware and software, and can also provide better services to users.
Besides, Katie. Huberty also believes that today's Tesla is very similar to Apple when the iPod was just released 20 years ago, because Tesla's innovation in the automotive field is very rapid, and this field needs a lot of innovation, which will arouse investors' interest.
In her report, she predicted that with reference to Tesla's current innovation trend and speed, there is likely to be a competitive relationship between Apple and Tesla in the next few years, and the two companies will not become partners.
After the report was released, former Apple executive Jean-Louis? Gassée wrote in Modaynote that although Apple has invested a lot of money in car research and development, the reality is cruel and Apple may not be able to make cars. He has two main reasons.
▲ Former Apple executive Jean-Louis? Gassie's article?
First, if Apple wants to build a car, it has to build a factory first, but there is no news that Apple has plans to build a car factory. Therefore, building a car is not Apple's short-term or medium-term plan, but a long-term plan.
Second, Apple makes cars. How to guarantee the profit? Looking at Tesla's financial report, we can find that although Tesla has the best sales in new energy vehicles, Tesla has not achieved full-year profit in one year. Today, Tesla hopes to achieve profitability by continuously reducing manufacturing costs, but how can Apple, which has no experience in building cars, reduce costs?
Jean-Louis, a former Apple executive? Gassée's article can be said to be a blow to Apple's car project. However, despite constant speculation and criticism, since 20 17, Apple has obtained at least 70 patents, which shows that Apple has never stopped making cars.
▲2065 438+09 Automotive patents obtained by Apple so far.
Many automobile patents obtained by Apple this year are iterations of previous patents, such as displaying CarPlay in LCD instruments, how to open and close doors more space-saving, and how to adjust suspension to improve ride comfort ... From the iteration of patents, we can see that Apple attaches importance to in-car experience and explores future travel modes.
In addition, the iteration of these patents has also gradually formed this apple car that has not yet appeared. As more and more patent details are disclosed, I believe that Apple will get closer and closer to us.
Second, how to do automatic driving? Sensor intercommunication? It can also be charged automatically.
Earlier this month, Apple obtained two patents for autonomous driving. One of them is the data sharing between autopilot sensors, which allows different sensors to correct each other's errors in the process of calculating data; Another patent is that the vehicle can run automatically and start charging automatically when the charging connector is connected.
These two patents are one of Apple's few patents on autonomous driving and charging, and they have also caused a lot of discussion.
1, vehicle sensor linkage? You can check each other's mistakes
According to the information released by the US Patent and Trademark Office, Apple obtained this patent on June 2, and the patent name is "Data Sharing in Sensor Data Processing". In other words, Apple hopes to share data after the sensor collects information, so that the decision-making process of autonomous driving is more accurate.
At present, most self-driving vehicles are usually equipped with multiple sensors, such as laser radar, millimeter wave radar, ultrasonic radar, camera, acceleration sensor participating in vehicle control and angular velocity sensor participating in direction control. These sensors have different detection capabilities and can observe the road information around and in front of the vehicle in real time.
After collecting data, the image information and depth information generated by the sensor will be sent to the automatic driving computer for calculation, and the vehicle can make decisions on speed and direction according to the calculation results.
The image information is a two-dimensional plane, the radar information has a longitudinal depth, and the acceleration sensor produces acceleration information, which cannot be processed or compared at the same time.
Therefore, under normal circumstances, the computer of the self-driving vehicle will process the data collected by the sensor separately, and then the vehicle will output the final result after calculation, and make a decision on speed and direction.
Although self-driving vehicles can be controlled in this way, if the decision is improper, it is likely to lead to confusion in vehicle driving strategy. For example, 10 years ago, when the vehicles of Google's self-driving company Waymo passed the intersection, such a chaotic scene appeared.
▲ Ten years ago, Waymo self-driving vehicles made chaotic decisions when passing through intersections.
With the continuous progress of autonomous driving decision-making, the scene of chaotic operation basically disappears, but operational errors still occur from time to time.
Back to Apple's patent, because the output result of each sensor may be inaccurate, it is impossible to calculate multiple data on the same platform, so an error correction mechanism can only be added in the calculation process to prevent errors from happening.
Apple engineers found a way. Because the original data can't be compared, the final output data can be combined to control the vehicle, so the data in the calculation process gradually approaches the final data. In other words, the data in the calculation process can be put together to correct each other.
After inputting data, it will go through three steps, namely, raw data processing, feature processing and decision processing. Apple hopes to add a data sharing mechanism before and after these three steps to check the accuracy of data at any time, so as to find errors in the calculation process in time.
▲ patent flow chart
What data can be shared between different sensors in the calculation process?
Apple used two sensors in the patent document, lidar and camera.
For example, a part of the projection point of the lidar can be connected with the key area of the picture taken by the camera (for example, the lower part of the picture is more prone to road changes). In addition, the classification of camera visual features and the classification of objects by lidar can be carried out at the same time. Feature recognition of lidar and feature fusion of camera can also exchange data.
▲ Apple cited the camera and lidar data sharing mechanism.
Before the final calculation result is output, the data between the camera and the lidar has been "checked" for three times, and the possibility of error is greatly reduced.
In addition to these two sensors, Apple also hopes to integrate infrared, millimeter-wave radar, ultrasonic radar, GPS, acceleration sensor and angular velocity sensor to calculate autopilot more accurately.
In fact, Apple has been applying for patents on autonomous driving since the beginning of the car-building project, including hiding lidar, recognizing traffic police gestures, "believing" algorithms to speed up calculation, and even observing passengers' psychological changes to adjust the driving mode of vehicles.
2, automatic driving to charge is no longer afraid of power failure.
In May this year, Apple obtained a patent called "Charging Station with Automatic Alignment Device". According to this patent, electric vehicles can automatically drive to the charging station and plug in the plug to charge.
Different from the usual "charging gun" charging method, Apple's charger is fixedly installed, and the vehicle can start charging after the plug is docked.
▲ Schematic diagram of automatic driving charging
In fact, autopilot charging is relatively simple, but it is still difficult to successfully align the plug. Therefore, the charging interface of Apple's charging pile can be adjusted up, down, left and right, especially when the angle of the vehicle is wrong, which can connect the power supply more quickly.
▲ Charging plug with adjustable height and angle
With the increasing popularity of electric vehicles today, the problems of charging and battery life have not been properly solved, which is one of the reasons why many consumers do not choose electric vehicles. If the vehicle can drive and charge automatically, the pain point of electric vehicle charging will be solved by at least half.
In addition, as can be seen from the patent picture, the sketch of the electric car does not look like a family car, but looks more like an unmanned delivery car or a minibus. If this car is equipped with automatic driving charging device, it will greatly change the unmanned distribution and travel industry, at least the employees in the industry don't have to worry about charging.
However, the charged metal contacts in Apple's patent are exposed to the air. In case of windy and rainy weather, contact with water is more prone to leakage. I wonder how Apple will solve this problem.
From these two patents, it can be found that in the process of autonomous driving, Apple solves various pain points in vehicle use from the perspective of user experience. Combining the previously hidden lidar and scene recognition in bad weather conditions can reflect Apple's great attention to autonomous driving. It can even be said that there is no soul without the self-driving Apple car.
Third, how to do the interior? CarPlay even instrument? Windows can change color.
Apple has also made great efforts in the driving experience in the car. Interior atmosphere, interior lighting, virtual reality and augmented reality system are all within the development scope of Apple. In Apple's vision, the future self-driving vehicles will become people's mobile space, not just travel tools. Since the beginning of this year, Apple has also made great efforts in the design of interior space. The LCD instrument displays the contents of CarPlay, the information of seats and floors in the car, and can adjust the color and reflectivity of the window at the same time, which looks very scientific.
With the continuous upgrading of autonomous driving, people's interior space will be qualitatively improved. With the increasing popularity of autonomous driving, whether the interior space is humanized will become another core of competition among major car companies.
1, the LCD instrument will become the second screen of CarPlay.
In 20 14, Apple introduced CarPlay, where drivers can use the car-machine system mapped by mobile phones in their cars. Since then, although CarPlay has software function updates, it can only be displayed on the central control screen of the vehicle, and other screens of the vehicle cannot display CarPlay content.
This makes drivers who use CarPlay have to switch their eyes to the central control screen of the car for viewing and operation, which increases the risk factor during driving.
▲ At present, CarPlay can only be displayed on a single screen.
In a patent obtained by Apple in March this year, Apple tried to expand CarPlay from one screen to multiple screens, and even used CarPlay in LCD instruments.
▲ LCD instrument will also support displaying CarPlay content.
If information is displayed in LCD instruments, fonts and pictures should be larger and information should be more concise. For example, during navigation, the LCD instrument will display the navigation route and direction. When you need to turn, the turning symbol will be displayed, which is easier to identify.
In fact, this function is easy to realize, but the coordination with major LCD instrument display manufacturers is slow. If all goes well, this function is likely to have been enjoyed in advance before the appearance of Apple cars.
2. Adjust the color and transparency of the window anytime and anywhere.
In addition to the very practical liquid crystal display CarPlay content, Apple also obtained a patent for a window, which can adjust the color, reflectivity and transparency according to the needs of the occupants, which can not only ensure the privacy of the car, but also adjust the atmosphere inside the car.
According to the description in the patent document, Apple inserted several interlayers in the window glass to adjust the color, reflectivity and fog of the window.
▲ Window adjustment can provide different combinations.
This function is also a just-needed product for future travel. If you have a work meeting in the car, but don't want the boss to know where you are, you can turn all the windows foggy. You can adjust the color of the window on the weekend outing to make the atmosphere inside the car more lively.
In fact, this can also be seen from the current Apple products. The interaction between software and hardware and the collaboration between devices is one of Apple's most valued experiences. Since the car screen can display navigation information, why can't the LCD display it? Since we want to ensure the privacy inside the car, why can't the window change color and be transparent? Although these small details that can enhance the in-car experience are not so eye-catching, they are really installed in the car, which is believed to be a great improvement to the driving experience.
Fourth, how to change the car hardware? ? When the door opens upwards, the suspension becomes intelligent.
In addition to autonomous driving, Apple actually pays great attention to the actual user experience. Take the monitor stand, one of Apple's most "unworthy" products, as an example. The price of 7799 is equivalent to that of high-end home monitors. When 20 19 was published on WWDC, it was an understatement. Stand sold for 999 dollars (about 7000 yuan), which still attracted the audience's laughter.
▲2065 438+09 Pro released in WWDC? Bracket display bracket
But when you really experience Pro? After Stand, you will find that other monitor stands are really difficult to use.
This monitor stand allows you to adjust the 7.5kg monitor with one finger, which is very friendly to any group who uses the monitor. However, even if Apple showed the anatomical diagram of the monitor bracket at the press conference, most people still don't know what is good about this thing.
▲ Pro displayed on 2065438+09 WWDC? Stand internal structure
The same may be true of Apple's car patents. Since 20 19, Apple has successively obtained four patents for doors and three patents for suspension. Although these two parts are relatively mature parts in the automobile structure, Apple seems to be not satisfied at all.
1, save space? The door is selected to open upwards.
In two patents in May and June of 20 19, Apple stipulated the structure and opening and closing mode of the door, but in the patent last September, it began to pay attention to the design of the door hinge.
In this patent, Apple seems to want the hinge of the door to be as smooth as the hinge of a MacBook laptop. At the same time, Apple added sensors to the door. If there is a dangerous situation outside the car, the door will give the occupant a force feedback to prevent the danger from happening.
Actually, it's nothing. Another car door patent that Apple obtained in May this year, from the picture, is far more detailed than the previous patent.
There are three main ways to open and close doors in buses sold. The first is to open the door to the outside, the second is the sliding door commonly used in commercial vehicles, and the third is the gull-wing door. Of the three ways to open the door, only the sliding door saves the most space, and Apple also hopes to use this way. However, Apple doesn't want the door to slide backwards, but slides upwards.
▲ The structure of the door in Apple's patent
As can be seen from the patent description, this kind of door can make the door rotate to the top of the vehicle, which will neither occupy the space on the left and right sides of the vehicle nor occupy the space above the vehicle. From this point of view, Apple seems to want to make a big innovation in the way of opening and closing doors.
▲ Door open state
However, from the picture, there are still problems. The parts of the door are so complicated, how can we keep it beautiful in the car? This may be something that Apple has to consider in the manufacturing process.
2. Identify the road conditions in real time and adjust the suspension.
In addition to the door, suspension is also the body part that Apple has been thinking about. 2065438+In May and July of 2009, Apple obtained two automobile suspension patents respectively. Previously, Apple hoped to improve the ride comfort of passengers under different driving conditions by adjusting the hardness of the suspension, and even slow down the motion sickness of passengers and reduce tire wear.
In February of this year, Apple once again obtained a suspension patent and named it "Active Suspension System". After detecting the current road conditions, the vehicle will actively adjust the suspension to keep the occupants comfortable.
▲ Cross section of vehicle suspension
Specifically, if driving on uneven roads such as gravel, the suspension of the vehicle will be actively adjusted, so that the energy jumping up and down in the wheel can be absorbed by the wheel as much as possible, instead of being transmitted to the car, so that the ride comfort will be higher.
In addition, Apple also specifically stated in this patent that even if the vehicle uses an automatic driving system, the suspension can be adjusted according to the road conditions.
Two facts can be deduced here: first, Apple really wants to be a self-driving car, and second, Apple's self-driving is all-round, not only driving by itself, but also other parameters can be adjusted by itself. Compared with other intelligent systems of automatic driving system, it can be described as a higher level.
5. How does the unmanned vehicle solve the safety problem? Insert the airbag into the seat belt.
In addition to the details, Apple also attaches great importance to the safety performance in the car. Among the newly obtained patents this year, there are three * * * related to driving and riding safety. Among them, the patent on airbag is very eye-catching.
In a patent obtained on May 12 this year, Apple described the measures taken by the vehicle when the occupants were sitting face to face after a collision accident.
In the traditional passenger car seat arrangement, the front seat backrest can often provide cushioning for the rear passengers, which can ensure the safety of passengers to a certain extent in the event of a collision. However, vehicles designed by Apple need to ride face to face. If there is a collision or sudden braking, two passengers may bump into each other, and it is likely that both of them will be injured at the same time.
Therefore, Apple hopes to pop up an airbag between them to protect the safety of the occupants.
However, even installing airbags is not that simple. At present, most models are equipped with steering wheel main driver airbag and center console airbag, which are supported by steering wheel or center console. In the event of a collision, the airbag will not shift and lose its cushioning effect.
However, there is no supporting surface between two passengers sitting face to face, and even if the airbag bounces off, it may shift and cannot play a buffering role. As a result, Apple proposed several solutions in the patent.
▲ seat belt airbag
First, seat belts and airbags. When the airbag cabin is installed in the seat belt, in case of danger, the airbag can bounce off the waist seat belt, which is equivalent to propping up a big balloon in front of passengers.
▲ "bigger" safety air curtain
The second is to install the airbag on the roof or side of the car. This design is equivalent to deploying the commonly used vehicle safety air curtain, which can directly block the upper body of the occupant.
It can be said that Apple took the initiative to put the airbag into the seat belt, which is very creative in form, and the actual safety effect needs strict testing.
Putting airbags in seat belts is an open mind for Apple engineers, but it is not the most imaginative. Previously, Apple engineers even wanted to put the touchpad in the seat belt and set a few buttons. The driver can even wake up Siri and answer the phone on the seat belt, which can be said to be very smart.
Conclusion: What kind of car does Apple want to build?
From around 20 14, Apple began to March into the automobile field, developing autonomous driving and applying for automobile patents. However, after so many years of research and development, Apple has really not achieved much substantive results. Many people suspect that Apple really wants to build a car.
Judging from Apple's automobile patents, Apple has been moving in the direction of making cars, and nearly 70 patents have basically drawn Apple? The outline of a car.
Judging from Apple's scientific and technological achievements for many years, it is definitely not willing to be the software of CarPlay, but is willing to be the hardware product developed by CarPlay, that is, the car.
Specifically, the car that Apple wants to build is electric-driven, with autonomous driving capability, and the car has powerful interactive functions based on CarPlay. Maybe Apple will upgrade to "CarOS" in the future. In the face of changes in future travel modes, Apple cars can even put away the steering wheel and let two rows of passengers ride face to face.
Speaking of which, it seems that there is really some flavor of future travel.
This article comes from car home, the author of the car manufacturer, and does not represent car home's position.