Waymo 的 AI 与基础模型负责人 Vincent Vanhoucke,谈到当车辆上的激光雷达、雷达和摄像头彼此给出不一致信息时,谁拥有最终裁决权: “并不是它们在投票。这是一种对不同信息的融合。我喜欢用这样一个例子来解释:你的左眼基本上会告诉大脑,你的鼻子在右边;你的右眼会告诉大脑,你的鼻子在左边。并不是某一只眼睛会赢得这场‘争论’。你大脑所做的,是把这些略有冲突的信息融合起来,从而获得对眼前场景的整体理解。 安全在很大程度上来自冗余。真正的安全,源于从不同信息来源获取数据,对任何单一来源都不百分之百信任,而是根据各类信息线索去合并证据。你加入的、来自不同来源的信息越多,对现实状态的整体判断就越准确。不同传感器之间发生的这种融合,正是实现高度安全感知系统的关键所在。” Waymo’s AI and foundation model lead, Vincent Vanhoucke, on who has the final authority when LiDAR, radar, and cameras on the vehicle disagree: “It’s not like they’re voting. It’s a merger of the different information. The example I like is this: your left eye basically tells your brain that your nose is on the right; your right eye tells your brain your nose is on the left. It’s not like one eye is going to win that contest. You basically fuse in your brain the different information that’s slightly conflicting, but that actually gives you a global picture of the scene in front of you. Safety is a lot about redundancy. Safety really comes from taking different sources of information, never entirely trusting them 100%, and merging the evidence based on the different hints of information you get. The more information you add that comes from different sources, the more you improve the overall estimate of your belief. The fusion that happens between the different sensors is really the crux of enabling a very safe perception stack.”
观点原文
Waymo 的 AI 与基础模型负责人 Vincent Vanhoucke,谈到当车辆上的激光雷达、雷达和摄像头彼此给出不一致信息时,谁拥有最终裁决权:
“并不是它们在投票。这是一种对不同信息的融合。我喜欢用这样一个例子来解释:你的左眼基本上会告诉大脑,你的鼻子在右边;你的右眼会告诉大脑,你的鼻子在左边。并不是某一只眼睛会赢得这场‘争论’。你大脑所做的,是把这些略有冲突的信息融合起来,从而获得对眼前场景的整体理解。
安全在很大程度上来自冗余。真正的安全,源于从不同信息来源获取数据,对任何单一来源都不百分之百信任,而是根据各类信息线索去合并证据。你加入的、来自不同来源的信息越多,对现实状态的整体判断就越准确。不同传感器之间发生的这种融合,正是实现高度安全感知系统的关键所在。”
Waymo’s AI and foundation model lead, Vincent Vanhoucke, on who has the final authority when LiDAR, radar, and cameras on the vehicle disagree:
“It’s not like they’re voting. It’s a merger of the different information. The example I like is this: your left eye basically tells your brain that your nose is on the right; your right eye tells your brain your nose is on the left. It’s not like one eye is going to win that contest. You basically fuse in your brain the different information that’s slightly conflicting, but that actually gives you a global picture of the scene in front of you.
Safety is a lot about redundancy. Safety really comes from taking different sources of information, never entirely trusting them 100%, and merging the evidence based on the different hints of information you get. The more information you add that comes from different sources, the more you improve the overall estimate of your belief. The fusion that happens between the different sensors is really the crux of enabling a very safe perception stack.”
ABAB AI 解读
这段话是在用人类感知作类比,解释自动驾驶为什么必须做“多传感器融合”,以及“安全”真正来自哪里。我分点解读它的技术与哲学含义。
1️⃣ 不是“投票”,而是融合(fusion)
LiDAR / 雷达 / 摄像头不是互相表决谁对谁错
也不存在“最终裁判”的单一传感器
系统做的是:把彼此略有冲突的信息合并,形成一个更接近真实世界的整体判断
👉 这否定了“哪个传感器更权威”的思路。
2️⃣ 左眼 / 右眼的比喻很关键
- 左眼与右眼给出的信息天然不一致
- 但大脑并不选择“相信哪只眼睛”
- 而是通过视差信息重建三维世界
👉 冲突不是问题,冲突本身反而是信息来源。
3️⃣ 安全的本质:冗余 + 不完全信任
他说了三层非常重要的安全原则:
冗余(redundancy)
多个传感器覆盖同一现实
任一失效,系统仍可工作
不 100% 信任任何单一来源
每个传感器都有盲区、噪声、失败模式
“完全信任”是事故的根源
基于证据的合并(evidence merging)
像贝叶斯推断一样
不断更新“我对世界的相信程度”
👉 安全不是“更强的单点”,而是更稳的系统。
4️⃣ “信息越多,信念越准”≠ 传感器越多越好
这里的隐含前提是:
- 信息必须来自不同物理原理
- 光学(摄像头)
- 电磁反射(雷达)
- 激光测距(LiDAR)
- 如果只是“同源复制”,并不会提高安全性。
👉 真正有效的是:异构信息的叠加。
5️⃣ 真正的结论:感知栈(perception stack)决定安全上限
自动驾驶的难点不在:
- 算法多复杂
- 模型多大
而在:能否把不完美的信息稳定融合
在不确定性下持续给出保守但正确的判断
👉 这解释了为什么像 Waymo 坚持多传感器路线。
一句话总结
这段话的核心是:真正的安全,不来自“最聪明的传感器”,而来自一个像人类大脑一样,能够在不确定与冲突中融合证据、逐步逼近真实世界的系统。
相关观点
- 2026 年将成为 Tesla 历史上规模最大的新品发布之年。 • Optimus 人形机器人(第三代) • Cybercab(无人驾驶出租车) • Tesla Semi(特斯拉电动半挂卡车) • Megapack 3 / Megablock(新一代大型储能系统) • 全新的家用太阳能面板 2026 will be the biggest new-product launch year in @Tesla’s history. • Optimus robot (Gen 3) • Cybercab • Tesla Semi • Megapack 3/Megablock • New residential solar panelSawyer Merritt · 2026/01/01
- 埃隆·马斯克今晚在 X Spaces 中谈到 2026 年的预期时表示:“特斯拉方面,我们应该会实现大范围的机器人出租车(Robotaxi),这将是 2026 年特斯拉的一件大事。Optimus V3 也将发布。随后,希望 SpaceX 能够通过星舰(Starship)实现完全可重复使用。” Elon Musk in an X Spaces tonight on what to expect in 2026: "Tesla, we should have widespread robotaxi. That will be a big thing for Tesla in 2026. Optimus V3 will launch. Then hopefully SpaceX will achieve full reusability with Starship."Sawyer Merritt · 2025/12/31
- 我认为,人们需要重新审视围绕埃隆“净资产”的讨论。随着他的净资产接近 1 万亿美元,理解更大的背景尤为重要。埃隆是通过正当方式获得财富的:他创建公司、打造产品与服务,真正被人们所喜爱,同时为股东创造了巨大的价值。他没有偷盗,也没有欺骗;他是在建设与创造。 埃隆并不是为了购买游艇、豪宅或度假而积累财富。他的资本主要是一种工具,用来追求他认为对人类长期未来最有益的结果,其中最重要的是让人类成为多行星物种。在火星建设将非常昂贵,他的很大一部分财富最终都会投入其中;与此同时,他也在地球上进行大量投资——截至目前,他通过旗下公司及其供应链创造了超过 60 万个就业岗位。 埃隆是世界上最出色的资本配置者之一,创造了多项改变世界的技术,造福了全人类。正因如此,当一些人说他应该缴纳更多税时,显得颇为讽刺(他的财富几乎全部是未实现的股票收益),因为这些资本如果被转移给政府,往往会交到最糟糕的资本配置者手中。 他在 2021 年缴纳了史上单笔最大的税款(110 亿美元);而当他行使 2018 年特斯拉 CEO 绩效奖励中的股票期权(将于 2028 年 1 月到期)时,未来很可能还会缴纳更大一笔税款。 随着他的财富增长,传统媒体及其他人对埃隆的妖魔化只会愈演愈烈。相反,他们更应该关注的是他为他人创造的巨大价值,以及他旗下公司正在做的所有好事: 特斯拉:加速迈向可持续未来,并通过自动驾驶技术拯救生命 Neuralink:通过脑植入芯片改善残障人士的生活 SpaceX / Starlink:为全球偏远地区提供互联网连接 The Boring Company:减少交通拥堵、缩短出行时间 xAI / Grok:利用 AI 解决问题、回答疑问、应对挑战 以及更多 不要用财富来衡量埃隆。用他建成了什么、正在创造和建设什么,以及没有他就不会存在的那些事物来衡量他。而那份清单,非常长。 I think people need to reframe the conversation around Elon’s “net worth.” As his net worth approaches $1 trillion, it’s important to understand the bigger picture. Elon earned his wealth the right way: by building companies and creating products and services that people genuinely love, while generating enormous shareholder value. He didn’t steal. He didn’t cheat. He built and created. Elon isn’t accumulating wealth to buy yachts, houses, or vacations. His capital is primarily a tool to pursue outcomes he believes are best for humanity’s long-term future, most notably making life multi-planetary. Building on Mars will be expensive, and much of Elon's wealth will ultimately go towards that, but he’s also investing heavily here on Earth, having created over 600,000 jobs so far across his companies and supply chains. Elon is the best capital allocator in the world, and has created multiple world-changing technologies that have benefited humanity. That’s why it’s ironic when some people say he should pay more taxes (almost all of his wealth is unrealized stock gains), because that capital would simply be redirected to the government, one of the worst capital allocators. He paid the single largest tax bill in history in 2021 ($11B) and will likely pay an even bigger one in the future when he exercises the stock options from his 2018 Tesla CEO Performance Award, which are set to expire in January 2028. The villainization of Elon by legacy media and others will only intensify as his wealth grows. Instead, what they should focus on is the massive value he has created for others and all the good his companies are doing: • Tesla: Accelerating toward a sustainable future and saving lives with self-driving cars • Neuralink: Improving the lives of disabled people with brain-implant chips • SpaceX/Starlink: Bringing internet connectivity to remote areas worldwide • The Boring Company: Reducing traffic and travel time • xAI/Grok: Using AI to solve problems, answer questions, and tackle challenges • And much more Don’t measure Elon by his wealth. Measure him by what he has built, what he’s creating/building, and all the things that wouldn’t exist without him. That list is long.Sawyer Merritt · 2025/12/31
- Waymo 在本周旧金山发生大规模停电、其无人驾驶出租车暂停运行后,刚刚发布了一份官方声明。 “我们希望向大家说明停电期间我们的运营情况,以及我们将如何持续演进,以更好地服务这座城市。 应对如此规模的事件,对自动驾驶技术来说是一次独特的挑战。虽然 Waymo Driver 的设计可以在交通信号灯熄灭时,将路口视为四向停靠(four-way stop),但在某些情况下,它会请求人工确认,以确保做出最安全的决策。周六当天,我们成功通过了 7,000 多个无信号灯路口,但此次停电导致这类确认请求在短时间内集中激增。这形成了请求积压,在部分情况下造成响应延迟,进而加剧了本就不堪重负的道路拥堵。 在早期部署阶段,我们本着高度谨慎的原则建立了这些确认机制;而现在,我们正在对其进行优化,以匹配当前的运营规模。虽然这种策略在较小规模的停电事件中行之有效,但我们目前正在部署全车队更新,为 Driver 提供明确的停电场景上下文,使其能够更果断地进行决策和通行。 随着停电持续,且市政府官员呼吁居民尽量减少外出、优先保障应急人员通行,我们在相关区域临时暂停了服务。我们指示车队就地靠边、规范停车,并分批将车辆送回车库。这确保我们不会在恢复高峰期进一步加剧交通拥堵,也不会阻碍应急车辆通行。” 前进方向 “我们正在对本次事件进行分析,并已开始整合从此次 PG&E 停电中获得的经验教训。以下是我们正在采取的一些即时措施: 整合更多停电信息: 虽然 Driver 已能将熄灭的交通信号灯视为四向停靠,但我们正在推出全车队更新,为车辆提供更丰富的区域停电信息,使其在这些路口做出更果断的判断。 更新应急准备与响应机制: 我们将改进应急响应流程,把此次事件的经验纳入其中。在旧金山,我们将继续与市长 Lurie 团队合作,寻找在现有应急预案中深化协作的空间。 扩大与应急人员的合作: 目前,我们已在美国及全球范围内培训了 25,000 多名应急人员,指导他们如何与 Waymo 车辆互动。随着我们从此次及其他大规模事件中获得新的经验,我们将持续更新对应的应急人员培训内容。” Waymo has just released an official statement following the massive power outage in San Francisco this week and their robotaxis shutting down. “We want to share an account of our operations during the outage and how we are evolving to better serve the city. Navigating an event of this magnitude presented a unique challenge for autonomous technology. While the Waymo Driver is designed to handle dark traffic signals as four-way stops, it may occasionally request a confirmation check to ensure it makes the safest choice. While we successfully traversed more than 7,000 dark signals on Saturday, the outage created a concentrated spike in these requests. This created a backlog that, in some cases, led to response delays contributing to congestion on already-overwhelmed streets. We established these confirmation protocols out of an abundance of caution during our early deployment, and we are now refining them to match our current scale. While this strategy was effective during smaller outages, we are now implementing fleet-wide updates that provide the Driver with specific power outage context, allowing it to navigate more decisively. As the outage persisted and City officials urged residents to stay off the streets to prioritize first responders, we temporarily paused our service in the area. We directed our fleet to pull over and park appropriately so we could return vehicles to our depots in waves. This ensured we did not further add to the congestion or obstruct emergency vehicles during the peak of the recovery effort. The path forward We are analyzing the event, and are already integrating the lessons from this weekend’s PG&E outage. Here are some of the immediate steps we’re taking: • Integrating more information about outages: While our Driver already handles dark traffic signals as four-way stops, we are now rolling out fleet-wide updates that give our vehicles even more context about regional outages, allowing them to navigate these intersections more decisively. • Updating our emergency preparedness and response: We will improve our emergency response protocols, incorporating lessons from this event. In San Francisco, we’ll continue to coordinate with Mayor Lurie’s team to identify areas of greater collaboration in our existing emergency preparedness plans. • Expanding our first responder engagement: To date, we’ve trained more than 25,000 first responders in the U.S. and around the world on how to interact with Waymo. As we discover learnings from this and other widespread events, we’ll continue updating our first responder training.”Sawyer Merritt · 2025/12/24