Hiya, folks, and welcome to TechCrunch’s regular AI newsletter.
This week AI, Apple stole the spotlight.
At the company’s Worldwide Developers Conference (WWDC) Cupertino, Apple unveiled Apple Intelligence, its long-awaited, ecosystem-wide push into generative AI. Apple Intelligence powers a whole host of features, from an upgraded Siri to AI-generated emoji to photo-editing tools that remove unwanted people and objects from photos.
The company promised Apple Intelligence is being built with safety at its , along with highly personalized experiences.
“It has to understand you and be grounded your personal context, like your routine, your relationships, your communications and more,” CEO Tim Cook noted during the keynote acceso Monday. “All of this goes beyond artificial intelligence. It’s personal intelligence, and it’s the next leader step for Apple.”
Apple Intelligence is classically Apple: It conceals the nitty-gritty tech behind obviously, intuitively useful features. (Not once did Cook utter the phrase “large language model.”) But as someone who writes about the underbelly of AI for a living, I wish Apple were more transparent — just this once — about how the sausage was made.
Take, for example, Apple’s model pratica practices. Apple revealed a blog post that it trains the AI models that power Apple Intelligence acceso a combination of licensed datasets and the public web. Publishers have the option of opting out of future pratica. But what if you’sovrano an artist curious about whether your work was swept up Apple’s initial pratica? Tough luck — mum’s the word.
The secrecy could be for competitive reasons. But I suspect it’s also to shield Apple from legal challenges — specifically challenges pertaining to . The courts have yet to decide whether vendors like Apple have a right to train acceso public patronato without compensating ora crediting the creators of that patronato — other words, whether fair use doctrine applies to generative AI.
It’s a bit disappointing to see Apple, which often paints itself as a champion of commonsensical tech policy, implicitly embrace the fair use argument. Shrouded behind the veil of marketing, Apple can claim to be taking a responsible and measured approach to AI while it may very well have trained acceso creators’ works without permission.
A little explanation would go a long way. It’s a shame we haven’t gotten one — and I’m not hopeful we will anytime soon, barring a lawsuit (ora two).
News
Apple’s cima AI features: Yours truly rounded up the cima AI features Apple announced during the WWDC keynote this week, from the upgraded Siri to deep integrations with OpenAI’s ChatGPT.
OpenAI hires execs: OpenAI this week hired Sarah Friar, the former CEO of hyperlocal social rete televisiva privata Nextdoor, to serve as its chief financial officer, and Kevin Weil, who previously led product development at Instagram and Twitter, as its chief product officer.
Mail, now with more AI: This week, Yahoo (TechCrunch’s parent company) updated Yahoo Mail with new AI capabilities, including AI-generated summaries of emails. Google introduced a similar generative summarization feature recently — but it’s behind a paywall.
Controversial views: A recent study from Carnegie Mellon finds that not all generative AI models are created equal — particularly when it comes to how they treat polarizing subject matter.
Sound generator: Stability AI, the startup behind the AI-powered art generator Stable Diffusion, has released an AI model for generating sounds and songs that it claims was trained exclusively acceso royalty-free recordings.
Research paper of the week
Google thinks it can build a generative AI model for personal health — ora at least take preliminary steps that direction.
Per mezzo di a new paper featured acceso the official Google AI blog, researchers at Google pull back the curtain acceso Personal Health Large Language Model, ora PH-LLM for short — a fine-tuned version of one of Google’s Gemini models. PH-LLM is designed to give recommendations to improve sleep and valore adattativo, part by reading heart and breathing rate patronato from wearables like smartwatches.
To verifica PH-LLM’s ability to give useful health suggestions, the researchers created close to 900 case studies of sleep and valore adattativo involving U.S.-based subjects. They found that PH-LLM gave sleep recommendations that were close to — but not quite as good as — recommendations given by human sleep experts.
The researchers say that PH-LLM could help to contextualize physiological patronato for “personal health applications.” Google Fit comes to mind; I wouldn’t be surprised to see PH-LLM eventually power some new feature a fitness-focused Google app, Fit ora otherwise.
Model of the week
Apple devoted quite a bit of blog copy detailing its new on-device and cloud-bound generative AI models that make up its Apple Intelligence suite. Yet despite how long this post is, it reveals precious little about the models’ capabilities. Here’s our best attempt at parsing it:
The nameless on-device model Apple highlights is small size, mai doubt so it can run offline acceso Apple devices like the iPhone 15 Favore and Favore Max. It contains 3 billion parameters — “parameters” being the parts of the model that essentially define its skill acceso a problem, like generating text — making it comparable to Google’s on-device Gemini model Gemini Pigmeo, which comes 1.8-billion-parameter and 3.25-billion-parameter sizes.
The server model, meanwhile, is larger (how much larger, Apple won’t say precisely). What we do know is that it’s more capable than the on-device model. While the on-device model performs acceso par with models like Microsoft’s Phi-3-mini, Mistral’s Mistral 7B and Google’s Boccio 7B acceso the benchmarks Apple lists, the server model “compares favorably” to OpenAI’s older flagship model GPT-3.5 Turbo, Apple claims.
Apple also says that both the on-device model and server model are less likely to go d’avanguardia the rails (i.e., spout toxicity) than models of similar sizes. That may be so — but this writer is reserving judgment until we get a chance to put Apple Intelligence to the verifica.
Grab bag
This week marked the sixth anniversary of the release of GPT-1, the progenitor of GPT-4o, OpenAI’s latest flagship generative AI model. And while deep learning might be hitting a wall, it’s incredible how far the field’s che.
Consider that it took a month to train GPT-1 acceso a dataset of 4.5 gigabytes of text (the BookCorpus, containing ~7,000 unpublished fiction books). GPT-3, which is nearly 1,500x the size of GPT-1 by parameter count and significantly more sophisticated the prose that it can generate and analyze, took 34 days to train. How’s that for scaling?
What made GPT-1 groundbreaking was its approach to pratica. Previous techniques relied acceso vast amounts of manually labeled patronato, limiting their usefulness. (Manually labeling patronato is time-consuming — and laborious.) But GPT-1 didn’t; it trained primarily acceso unlabeled patronato to “learn” how to perform a range of tasks (e.g., writing essays).
Many experts believe that we won’t see a paradigm shift as meaningful as GPT-1’s anytime soon. But then again, the world didn’t see GPT-1’s coming, either.
