Connect with us

Tech

OpenAI Jalapeño Benchmark Promises Faster AI

Published

on

In June 2026, Broadcom CEO Hock Tan and President Charlie Kawwas delivered Jalapeño to OpenAI CEO Sam Altman and President Greg Brockman. The custom AI inference chip was designed by OpenAI and co-developed with Broadcom.

OpenAI has now published its first benchmark results for Jalapeño following tests using InferenceX, a public AI inference benchmark from SemiAnalysis. The company said the chip delivered 1.5 to 1.9 times greater peak performance per watt than the Nvidia Blackwell systems used for comparison.

The results were produced by OpenAI rather than an independent testing organization, and the company normalized them using each accelerator’s published power rating.

What Jalapeño brings

Jalapeño was designed to work across different models, not only OpenAI’s systems. The ASIC (Application-Specific Integrated Circuit) was tested with GPT-OSS 120B and two non-OpenAI models: DeepSeek R1 670B and Kimi K2.5 1T. OpenAI said the results demonstrate that the architecture is not restricted to its own models.

AI inference has several phases with different bottlenecks. During prefill, the system processes the user’s prompt, which is compute-intensive. During decode, it generates the response token by token and relies more heavily on memory bandwidth. Communication between cores and chips can add further latency and reduce an AI model’s responsiveness.

Jalapeño has been designed to combine both high batch throughput and real-time responsiveness. OpenAI says that it has built a flexible AI accelerator “that can support changing model architectures, excel at both prefill and decode, and adapt as the balance between them changes, a defining feature of agentic workloads.”

One architectural feature behind this performance is a localized KV cache. OpenAI says model data can be explicitly placed and kept close to the required compute resources, reducing the time and power spent moving data during inference.

OpenAI says the resulting design can support high batch throughput and real-time responsiveness without making the same trade-off between throughput and latency found in some existing systems.

More must-read AI coverage

What Jalapeño means for enterprise users

Earlier this month, OpenAI launched a limited preview of an Ultrafast service tier that runs GPT-5.6 Sol at up to 14 times the speed of Standard processing. The service, powered by Cerebras, can generate up to 750 output tokens per second.

The Cerebras announcement came less than two months after OpenAI unveiled Jalapeño. Together, the announcements show that OpenAI is pursuing a multi-vendor infrastructure strategy rather than immediately replacing Nvidia and Cerebras hardware with its own chip.

OpenAI has confirmed that Jalapeño will complement rather than replace its partner-supplied accelerators. The company said: “Meeting growing demand for AI will require more compute from every available source. We will continue to widely deploy accelerators from NVIDIA and other partners for both training and inference workloads.”

For enterprise customers, Jalapeño could eventually mean faster AI responses, greater service capacity and lower inference costs. OpenAI plans to begin deploying the chip within its own infrastructure by the end of 2026, but it has not said whether customers will be able to select the hardware directly or how the efficiency gains will affect API pricing. Those details will determine whether the benchmark produces a measurable advantage for businesses.

Read more: OpenAI’s first Jalapeño announcement explains five things businesses should know about the custom inference chip, including its potential cost savings and infrastructure trade-offs.

>

Continue Reading

Tech

Rivian’s CFO is leaving the company

Published

on

Rivian’s chief financial officer Claire McDonough is resigning her position at the end of October, the company announced in a regulatory filing Thursday.

The company said McDonough is stepping down to “pursue a new opportunity and relocate to the East Coast to be closer to her family.” Rivian said her resignation is “not the result of any disagreement.” The company is already searching for a replacement, and vice president of finance Derek Mulvey will serve as interim CFO once McDonough leaves her post.

Her departure comes as Rivian takes on some of its biggest projects to date, including scaling up production and sales of its R2 SUV, which started shipping to customers this summer.

This story is developing…

When you purchase through links in our articles, we may earn a small commission. This doesn’t affect our editorial independence.

>

Continue Reading

Tech

Bluesky adds an ‘algorithmic opt-out’ feature for those who don’t want to go viral

Published

on

After adding support for longer videos just yesterday, open social network Bluesky on Thursday introduced a new algorithmic opt-out feature that allows users to stop their posts from appearing in the app’s main Discover feed.

That algorithmic feed can currently surface any post on Bluesky’s network, as posts on the network are public by default.

To be clear, this latest change isn’t a way to make posts private — Bluesky is still working on rolling out support for private data at the protocol level. Instead, the feature simply makes a user’s public posts less discoverable to people outside their existing personal network.

The company says it created the feature because not everyone using its social media site wants to go viral. Sometimes, people just want to post for their followers without having their words exposed to larger crowds.

To opt out of having posts shown in the Discover feed, users can toggle on a new option in the app’s Privacy and Security settings. The change can take up to an hour to fully take effect, the company says.

Image Credits:Bluesky

It’s also worth noting that Bluesky’s implementation of the feature extends beyond its own app.

Instead of just being a setting that applies only within Bluesky, the preference is recorded at the account level. That means the choice travels with the user, even if they’re posting from another app that is powered by the same underlying protocol that Bluesky uses, AT Proto.

However, while those other apps have access to this information, they still have to choose to whether to respect it.

>

Continue Reading

Tech

Buried in Meta’s $18B settlement is a legal pass on kids’ data

Published

on

In addition to paying out up to $18 billion and adding child safety measures, Meta’s settlement agreement with attorneys general from 29 states includes an interesting provision: the states have agreed not to sue Meta under existing child safety laws over its retention and use of children’s data.

That permission is being granted for the limited purpose of training and testing Meta’s age-assurance model and includes guardrails, but it’s a curious policy decision to make in a case centered on child safety, and one that could be difficult to properly enforce.

As specified in the settlement agreement, Meta must develop, train, and begin testing a model designed to detect which users on Meta’s platforms are under the age of 13. This must be done within a year of the document’s effective date. (While the agreement doesn’t specify that the model has to be AI-based, Meta’s current age-detection tools are powered by AI technology.)

Under U.S. child safety law, COPPA (the Children’s Online Privacy Protection Act), typically requires that websites and apps limit the collection and retention of children’s personal information. Meta’s settlement agreement says that Meta shouldn’t need to violate COPPA to train or implement its age-assurance models. However, the agreement also says that the state AGs have agreed “fully, finally, and forever” not to bring any past, present or future COPPA claims — or claims under similar state laws — related to Meta’s use of children’s data.

The agreement makes clear that Meta can’t use data from users under age 13 for ad targeting, marketing, or algorithmic optimization.

Meta’s request for legal protection, and the state AGs’ willingness to grant it, isn’t unreasonable, says Philip N. Yannella, a partner at law firm Blank Rome and co-chair of its Privacy, Security & Data Protection practice. “These kinds of data minimization guardrails are pretty typical for privacy compliance: e.g., verifying compliance with deletion requests,” he said, though he noted a caveat: COPPA is a federal law primarily enforced by the FTC, not the states, so it’s unclear whether the FTC, which isn’t a party to this settlement, has separately agreed to the same compromise.

It can be difficult for companies to keep data technically and organizationally isolated from the rest of their systems. Yet Meta is being asked to do just that — to isolate its understanding of children’s behavior signals and other data and use it solely for detecting and removing under-13 users. Fortunately, an independent auditor will be involved in monitoring Meta’s compliance with the settlement so we don’t only have to rely on Meta’s word.

Policing this limitation could be complicated. The data could hypothetically feed into other Meta systems over time, or could raise questions over whether the data, signals, or insights derived from it are being used elsewhere within the company. What’s not clear from the agreement is what data Meta will retain for training the model, how much behavioral information that may include, or how long it will retain the data. We also don’t know how these models will change in the future as Meta meets the settlement’s terms.

Barring state AGs from raising COPPA or similar state-law claims over this use of children’s data in the future could complicate the legal avenues states can pursue if questions arise around how Meta is using the data.

That doesn’t prevent them from pursuing legal claims, notes Joshua Wurtzel, a partner at Schlam Stone & Dolan LLP. “If Meta uses the data outside those lines, the release and covenant not to sue don’t apply,” he said. But those legal disputes could still be complicated, since they’d hinge on whether Meta’s use of the data fell within the settlement’s terms.

Peter Jackson, a Data & IP attorney at Greenberg Glusker LLP, agrees, saying the carve-out here could “disincentivize future enforcement actions.”

“The Settlement Agreement’s age-assurance measures bear all the hallmarks of a heavy, and perhaps hasty, negotiation,” he says.

The decision also touches on a broader question that’s been coming up across the AI industry lately, especially as more AI agents are being developed to help consumers with various tasks. The systems often require significant access to users’ personal data to work well. Similarly, Meta may need deep insight into children’s use of social media use in order to identify which accounts belong to young people.

When you purchase through links in our articles, we may earn a small commission. This doesn’t affect our editorial independence.

>

Continue Reading

Trending

Copyright © 2017 Zox News Theme. Theme by MVP Themes, powered by WordPress.