ChatGPT

nsaspook

Joined Aug 27, 2009
16,329
https://www.msn.com/en-us/money/oth...hind-schedule-and-crazy-expensive/ar-AA1wfMCB
The Next Great Leap in AI Is Behind Schedule and Crazy Expensive
At best, they say, Orion performs better than OpenAI’s current offerings, but hasn’t advanced enough to justify the enormous cost of keeping the new model running. A six-month training run can cost around half a billion dollars in computing costs alone, based on public and private estimates of various aspects of the training.
...
OpenAI’s solution was to create data from scratch.

It is hiring people to write fresh software code or solve math problems for Orion to learn from. The workers, some of whom are software engineers and mathematicians, also share explanations for their work with Orion.

Many researchers think code, the language of software, can help LLMs work through problems they haven’t already seen.
Researchers at Apple recently released a paper that argues reasoning models, including versions of o1, were most likely mimicking the data they saw in training rather than actually solving new problems.

The Apple researchers said they found “catastrophic performance drops” if questions were changed to include irrelevant details—like tweaking a math problem about kiwis to note that some of the fruits were smaller than others.
 

nsaspook

Joined Aug 27, 2009
16,329
https://www.bloomberg.com/graphics/2024-ai-power-home-appliances/
AI Needs So Much Power, It’s Making Yours Worse
The Chicago area is served by Exelon Corp.’s Commonwealth Edison utility.

“ComEd strongly questions the accuracy and underlying assumptions of Whisker Lab’s claims,” utility spokesman John Schoen said in an email. “Ting devices are installed in the home and do not directly measure harmonics on the grid,” he said, adding that the utility meets power delivery standards set by the Illinois regulator and that the company’s data, which is taken from system equipment, disputes the Whisker Labs data. ComEd declined to share that data with Bloomberg News.

While distortions on the level of individual homes can be related to issues within that residence, Bloomberg’s analysis showed that worse harmonics were typically observed across multiple sensors in the same area, which Whisker Labs has said is more likely to indicate grid problems rather than issues from inside a home.
 

WBahn

Joined Mar 31, 2012
32,870
I've been seeing a lot of news stories about how the New Orleans attacker used ChatGPT to learn how to build the bombs.

All of the stories are focused on the need for law enforcement to be able to detect these kinds of queries before an attack happens (never mind about what that means for privacy and free speech).

None of them have noted the most notable point though -- the bombs didn't go off because, apparently, ChatGPT gave the guy bad information.

Gee. What a shocker there!
 

nsaspook

Joined Aug 27, 2009
16,329
https://techcrunch.com/2025/01/14/o...hinese-sometimes-and-no-one-really-knows-why/
OpenAI’s AI reasoning model ‘thinks’ in Chinese sometimes and no one really knows why
Other experts don’t buy the o1 Chinese data labeling hypothesis, however. They point out that o1 is just as likely to switch to Hindi, Thai, or a language other than Chinese while teasing out a solution.
Rather, these experts say, o1 and other reasoning models might simply be using languages they find most efficient to achieve an objective (or hallucinating).
“The model doesn’t know what language is, or that languages are different,” Matthew Guzdial, an AI researcher and assistant professor at the University of Alberta, told TechCrunch. “It’s all just text to it.”
Indeed, models don’t directly process words. They use tokens instead. Tokens can be words, such as “fantastic.” Or they can be syllables, like “fan,” “tas,” and “tic.” Or they can even be individual characters in words — e.g. “f,” “a,” “n,” “t,” “a,” “s,” “t,” “i,” “c.”
Like labeling, tokens can introduce biases. For example, many word-to-token translators assume a space in a sentence denotes a new word, despite the fact that not all languages use spaces to separate words.
 

nsaspook

Joined Aug 27, 2009
16,329
Last edited:
Top