Artificial Intelligence Could Finally Let Us Talk with Animals

[bnew]

Artificial Intelligence Could Finally Let Us Talk with Animals

AI is poised to revolutionize our understanding of animal communication

www.scientificamerican.com

Artificial Intelligence Could Finally Let Us Talk with Animals​

AI is poised to revolutionize our understanding of animal communication

• By Lois Parshley on October 1, 2023
  Scientific American October 2023 Issue

The Project Cetacean Translation Initiative (CETI) is using machine learning to try to understand the vocalizations of sperm whales. Credit: Franco Banfi/Minden Pictures

Underneath the thick forest canopy on a remote island in the South Pacific, a New Caledonian Crow peers from its perch, dark eyes glittering. The bird carefully removes a branch, strips off unwanted leaves with its bill and fashions a hook from the wood. The crow is a perfectionist: if it makes an error, it will scrap the whole thing and start over. When it's satisfied, the bird pokes the finished utensil into a crevice in the tree and fishes out a wriggling grub.

The New Caledonian Crow is one of the only birds known to manufacture tools, a skill once thought to be unique to humans. Christian Rutz, a behavioral ecologist at the University of St Andrews in Scotland, has spent much of his career studying the crow's capabilities. The remarkable ingenuity Rutz observed changed his understanding of what birds can do. He started wondering if there might be other overlooked animal capacities. The crows live in complex social groups and may pass toolmaking techniques on to their offspring. Experiments have also shown that different crow groups around the island have distinct vocalizations. Rutz wanted to know whether these dialects could help explain cultural differences in toolmaking among the groups.

New technology powered by artificial intelligence is poised to provide exactly these kinds of insights. Whether animals communicate with one another in terms we might be able to understand is a question of enduring fascination. Although people in many Indigenous cultures have long believed that animals can intentionally communicate, Western scientists traditionally have shied away from research that blurs the lines between humans and other animals for fear of being accused of anthropomorphism. But with recent breakthroughs in AI, “people realize that we are on the brink of fairly major advances in regard to understanding animals' communicative behavior,” Rutz says.

Beyond creating chatbots that woo people and producing art that wins fine-arts competitions, machine learning may soon make it possible to decipher things like crow calls, says Aza Raskin, one of the founders of the nonprofit Earth Species Project. Its team of artificial-intelligence scientists, biologists and conservation experts is collecting a wide range of data from a variety of species and building machine-learning models to analyze them. Other groups such as the Project Cetacean Translation Initiative (CETI) are focusing on trying to understand a particular species, in this case the sperm whale.

Decoding animal vocalizations could aid conservation and welfare efforts. It could also have a startling impact on us. Raskin compares the coming revolution to the invention of the telescope. “We looked out at the universe and discovered that Earth was not the center,” he says. The power of AI to reshape our understanding of animals, he thinks, will have a similar effect. “These tools are going to change the way that we see ourselves in relation to everything.”

When Shane Gero got off his research vessel in Dominica after a recent day of fieldwork, he was excited. The sperm whales that he studies have complex social groups, and on this day one familiar young male had returned to his family, providing Gero and his colleagues with an opportunity to record the group's vocalizations as they reunited.

For nearly 20 years Gero, a scientist in residence at Carleton University in Ottawa, kept detailed records of two clans of sperm whales in the turquoise waters of the Caribbean, capturing their clicking vocalizations and what the animals were doing when they made them. He found that the whales seemed to use specific patterns of sound, called codas, to identify one another. They learn these codas much the way toddlers learn words and names, by repeating sounds the adults around them make.

Having decoded a few of these codas manually, Gero and his colleagues began to wonder whether they could use AI to speed up the translation. As a proof of concept, the team fed some of Gero's recordings to a neural network, an algorithm that learns skills by analyzing data. It was able to correctly identify a small subset of individual whales from the codas 99 percent of the time. Next the team set an ambitious new goal: listen to large swathes of the ocean in the hopes of training a computer to learn to speak whale. Project CETI, for which Gero serves as lead biologist, plans to deploy an underwater microphone attached to a buoy to record the vocalizations of Dominica's resident whales around the clock.

As sensors have gotten cheaper and technologies such as hydrophones, biologgers and drones have improved, the amount of animal data has exploded. There's suddenly far too much for biologists to sift through efficiently by hand. AI thrives on vast quantities of information, though. Large language models such as ChatGPT must ingest massive amounts of text to learn how to respond to prompts: ChatGPT-3 was trained on around 45 terabytes of text data, a good chunk of the entire Library of Congress. Early models required humans to classify much of those data with labels. In other words, people had to teach the machines what was important. But the next generation of models learned how to “self-supervise,” automatically learning what's essential and independently creating an algorithm of how to predict what words come next in a sequence.

In 2017 two research groups discovered a way to translate between human languages without the need for a Rosetta stone. The discovery hinged on turning the semantic relations between words into geometric ones. Machine-learning models are now able to translate between unknown human languages by aligning their shapes—using the frequency with which words such as “mother” and “daughter” appear near each other, for example, to accurately predict what comes next. “There's this hidden underlying structure that seems to unite us all,” Raskin says. “The door has been opened to using machine learning to decode languages that we don't already know how to decode.”

The field hit another milestone in 2020, when natural-language processing began to be able to “treat everything as a language,” Raskin explains. Take, for example, DALL-E 2, one of the AI systems that can generate realistic images based on verbal descriptions. It maps the shapes that represent text to the shapes that represent images with remarkable accuracy—exactly the kind of “multimodal” analysis the translation of animal communication will probably require.

Many animals use different modes of communication simultaneously, just as humans use body language and gestures while talking. Any actions made immediately before, during, or after uttering sounds could provide important context for understanding what an animal is trying to convey. Traditionally, researchers have cataloged these behaviors in a list known as an ethogram. With the right training, machine-learning models could help parse these behaviors and perhaps discover novel patterns in the data. Scientists writing in the journal Nature Communications last year, for example, reported that a model found previously unrecognized differences in Zebra Finch songs that females pay attention to when choosing mates. Females prefer partners that sing like the birds the females grew up with.

You can already use one kind of AI-powered analysis with Merlin, a free app from the Cornell Lab of Ornithology that identifies bird species. To identify a bird by sound, Merlin takes a user's recording and converts it into a spectrogram—a visualization of the volume, pitch and length of the bird's call. The model is trained on Cornell's audio library, against which it compares the user's recording to predict the species identification. It then compares this guess to eBird, Cornell's global database of observations, to make sure it's a species that one would expect to find in the user's location. Merlin can identify calls from more than 1,000 bird species with remarkable accuracy.

But the world is loud, and singling out the tune of one bird or whale from the cacophony is difficult. The challenge of isolating and recognizing individual speakers, known as the cocktail party problem, has long plagued efforts to process animal vocalizations. In 2021 the Earth Species Project built a neural network that can separate overlapping animal sounds into individual tracks and filter background noise, such as car honks—and it released the open-source code for free. It works by creating a visual representation of the sound, which the neural network uses to determine which pixel is produced by which speaker. In addition, the Earth Species Project recently developed a so-called foundational model that can automatically detect and classify patterns in datasets.

New Caledonian Crows, which are famous for their toolmaking abilities, have regionally distinctive vocalizations that could one day be deciphered using AI. Credit: Jean-Paul Ferrero/Auscape International Pty Ltd/Alamy Stock Photo

 

[bnew]

Not only are these tools transforming research, but they also have practical value. If scientists can translate animal sounds, they may be able to help imperiled species. The Hawaiian Crow, known locally as the ‘Alalā, went extinct in the wild in the early 2000s. The last birds were brought into captivity to start a conservation breeding program. Expanding on his work with the New Caledonian Crow, Rutz is now collaborating with the Earth Species Project to study the Hawaiian Crow's vocabulary. “This species has been removed from its natural environment for a very long time,” he says. He is developing an inventory of all the calls the captive birds currently use. He'll compare that to historical recordings of the last wild Hawaiian Crows to determine whether their repertoire has changed in captivity. He wants to know whether they may have lost important calls, such as those pertaining to predators or courtship, which could help explain why reintroducing the crow to the wild has proved so difficult.

Machine-learning models could someday help us figure out our pets, too. For a long time animal behaviorists didn't pay much attention to domestic pets, says Con Slobodchikoff, author of Chasing Doctor Dolittle: Learning the Language of Animals. When he began his career studying prairie dogs, he quickly gained an appreciation for their sophisticated calls, which can describe the size and shape of predators. That experience helped to inform his later work as a behavioral consultant for misbehaving dogs. He found that many of his clients completely misunderstood what their dog was trying to convey. When our pets try to communicate with us, they often use multimodal signals, such as a bark combined with a body posture. Yet “we are so fixated on sound being the only valid element of communication, that we miss many of the other cues,” he says.

Now Slobodchikoff is developing an AI model aimed at translating a dog's facial expressions and barks for its owner. He has no doubt that as researchers expand their studies to domestic animals, machine-learning advances will reveal surprising capabilities in pets. “Animals have thoughts, hopes, maybe dreams of their own,” he says.

Farmed animals could also benefit from such depth of understanding. Elodie F. Briefer, an associate professor in animal behavior at the University of Copenhagen, has shown that it's possible to assess animals' emotional states based on their vocalizations. She recently created an algorithm trained on thousands of pig sounds that uses machine learning to predict whether the animals were experiencing a positive or negative emotion. Briefer says a better grasp of how animals experience feelings could spur efforts to improve their welfare.

But as good as language models are at finding patterns, they aren't actually deciphering meaning—and they definitely aren't always right. Even AI experts often don't understand how algorithms arrive at their conclusions, making them harder to validate. Benjamin Hoffman, who helped to develop the Merlin app before joining the Earth Species Project, says that one of the biggest challenges scientists now face is figuring out how to learn from what these models discover.
“The choices made on the machine-learning side affect what kinds of scientific questions we can ask,” Hoffman says. Merlin Sound ID, he explains, can help detect which birds are present, which is useful for ecological research. It can't, however, help answer questions about behavior, such as what types of calls an individual bird makes when it interacts with a potential mate. In trying to interpret different kinds of animal communication, Hoffman says researchers must also “understand what the computer is doing when it's learning how to do that.”

Daniela Rus, director of the Massachusetts Institute of Technology Computer Science and Artificial Intelligence Laboratory, leans back in an armchair in her office, surrounded by books and stacks of papers. She is eager to explore the new possibilities for studying animal communication that machine learning has opened up. Rus previously designed remote-controlled robots to collect data for whale-behavior research in collaboration with biologist Roger Payne, whose recordings of humpback whale songs in the 1970s helped to popularize the Save the Whales movement. Now Rus is bringing her programming experience to Project CETI. Sensors for underwater monitoring have rapidly advanced, providing the equipment necessary to capture animal sounds and behavior. And AI models capable of analyzing those data have improved dramatically. But until recently, the two disciplines hadn't been joined.

At Project CETI, Rus's first task was to isolate sperm whale clicks from the background noise of the ocean realm. Sperm whales' vocalizations were long compared to binary code in the way that they represent information. But they are more sophisticated than that. After she developed accurate acoustic measurements, Rus used machine learning to analyze how these clicks combine into codas, looking for patterns and sequences. “Once you have this basic ability,” she says, “then we can start studying what are some of the foundational components of the language.” The team will tackle that question directly, Rus says, “analyzing whether the [sperm whale] lexicon has the properties of language or not.”

But grasping the structure of a language is not a prerequisite to speaking it—not anymore, anyway. It's now possible for AI to take three seconds of human speech and then hold forth at length with its same patterns and intonations in an exact mimicry. In the next year or two, Raskin predicts, “we'll be able to build this for animal communication.” The Earth Species Project is already developing AI models that emulate a variety of species, with the aim of having “conversations” with animals. He says two-way communication will make it that much easier for researchers to infer the meaning of animal vocalizations.

In collaboration with outside biologists, the Earth Species Project plans to test playback experiments, playing an artificially generated call to Zebra Finches in a laboratory setting and then observing how the birds respond. Soon “we'll be able to pass the finch, crow or whale Turing test,” Raskin asserts, referring to the point at which the animals won't be able to tell they are conversing with a machine rather than one of their own. “The plot twist is that we will be able to communicate before we understand.”

The prospect of this achievement raises ethical concerns. Karen Bakker, a digital innovations researcher and author of The Sounds of Life: How Digital Technology Is Bringing Us Closer to the Worlds of Animals and Plants, explains that there may be unintended ramifications. Commercial industries could use AI for precision fishing by listening for schools of target species or their predators; poachers could deploy these techniques to locate endangered animals and impersonate their calls to lure them closer. For animals such as humpback whales, whose mysterious songs can spread across oceans with remarkable speed, the creation of a synthetic song could, Bakker says, “inject a viral meme into the world's population” with unknown social consequences.

So far the organizations at the leading edge of this animal-communication work are nonprofits like the Earth Species Project that are committed to open-source sharing of data and models and staffed by enthusiastic scientists driven by their passion for the animals they study. But the field might not stay that way—profit-driven players could misuse this technology. In a recent article in Science, Rutz and his co-authors noted that “best-practice guidelines and appropriate legislative frameworks” are urgently needed. “It's not enough to make the technology,” Raskin warns. “Every time you invent a technology, you also invent a responsibility.”

Designing a “whale chatbot,” as Project CETI aspires to do, isn't as simple as figuring out how to replicate sperm whales' clicks and whistles; it also demands that we imagine an animal's experience. Despite major physical differences, humans actually share many basic forms of communication with other animals. Consider the interactions between parents and offspring. The cries of mammalian infants, for example, can be incredibly similar, to the point that white-tailed deer will respond to whimpers whether they're made by marmots, humans or seals. Vocal expression in different species can develop similarly, too. Like human babies, harbor seal pups learn to change their pitch to target a parent's eardrums. And both baby songbirds and human toddlers engage in babbling—a “complex sequence of syllables learned from a tutor,” explains Johnathan Fritz, a research scientist at the University of Maryland's Brain and Behavior Initiative.

Whether animal utterances are comparable to human language in terms of what they convey remains a matter of profound disagreement, however. “Some would assert that language is essentially defined in terms that make humans the only animal capable of language,” Bakker says, with rules for grammar and syntax. Skeptics worry that treating animal communication as language, or attempting to translate it, may distort its meaning.

Raskin shrugs off these concerns. He doubts animals are saying “pass me the banana,” but he suspects we will discover some basis for communication in common experiences. “It wouldn't surprise me if we discovered [expressions for] ‘grief’ or ‘mother’ or ‘hungry’ across species,” he says. After all, the fossil record shows that creatures such as whales have been vocalizing for tens of millions of years. “For something to survive a long time, it has to encode something very deep and very true.”

Ultimately real translation may require not just new tools but the ability to see past our own biases and expectations. Last year, as the crusts of snow retreated behind my house, a pair of Sandhill Cranes began to stalk the brambles. A courtship progressed, the male solicitous and preening. Soon every morning one bird flapped off alone to forage while the other stayed behind to tend their eggs. We fell into a routine, the birds and I: as the sun crested the hill, I kept one eye toward the windows, counting the days as I imagined cells dividing, new wings forming in the warm, amniotic dark.

Then one morning it ended. Somewhere behind the house the birds began to wail, twining their voices into a piercing cry until suddenly I saw them both running down the hill into the stutter start of flight. They circled once and then disappeared. I waited for days, but I never saw them again.

Wondering if they were mourning a failed nest or whether I was reading too much into their behavior, I reached out to George Happ and Christy Yuncker, retired scientists who for two decades shared their pond in Alaska with a pair of wild Sandhill Cranes they nicknamed Millie and Roy. They assured me that they, too, had seen the birds react to death. After one of Millie and Roy's colts died, Roy began picking up blades of grass and dropping them near his offspring's body. That evening, as the sun slipped toward the horizon, the family began to dance. The surviving colt joined its parents as they wheeled and jumped, throwing their long necks back to the sky.

Happ knows critics might disapprove of their explaining the birds' behaviors as grief, considering that “we cannot precisely specify the underlying physiological correlates.” But based on the researchers' close observations of the crane couple over a decade, he writes, interpreting these striking reactions as devoid of emotion “flies in the face of the evidence.”

Everyone can eventually relate to the pain of losing a loved one. It's a moment ripe for translation.

Perhaps the true value of any language is that it helps us relate to others and in so doing frees us from the confines of our own minds. Every spring, as the light swept back over Yuncker and Happ's home, they waited for Millie and Roy to return. In 2017 they waited in vain. Other cranes vied for the territory. The two scientists missed watching the colts hatch and grow. But last summer a new crane pair built a nest. Before long, their colts peeped through the tall grass, begging for food and learning to dance. Life began a new cycle. “We're always looking at nature,” Yuncker says, “when really, we're part of it.”

This article was originally published with the title "Talking with Animals" in Scientific American 329, 3, 44-49 (October 2023)
doi:10.1038/scientificamerican1023-44

 

[brickfare]

The prospect of this achievement raises ethical concerns. Karen Bakker, a digital innovations researcher and author of The Sounds of Life: How Digital Technology Is Bringing Us Closer to the Worlds of Animals and Plants, explains that there may be unintended ramifications. Commercial industries could use AI for precision fishing by listening for schools of target species or their predators; poachers could deploy these techniques to locate endangered animals and impersonate their calls to lure them closer. For animals such as humpback whales, whose mysterious songs can spread across oceans with remarkable speed, the creation of a synthetic song could, Bakker says, “inject a viral meme into the world's population” with unknown social consequences.

YIKES

 

[Mowgli]

We can't have nice things

 

[bnew]

YIKES

its a good thing people are concerning themselves without possible abuses now than being caught off-guard much later.

 

[Wargames]

its a good thing people are concerning themselves without possible abuses now than being caught off-guard much later.

Yeah I agree because we know they are going to abuse this later

 

[Ya Sinning Mane]

I’m not believing what ai is saying they are saying tbh

 

[Secure Da Bag]

If you can communicate with animals, then is it still right to kill them? You can't deny their (level of) sentience anymore if communication is possible.

Could this be the 1st step of worldwide artificial meat?

 

[bnew]

I’m not believing what ai is saying they are saying tbh

Incredible to think about what new discoveries A.I. will uncover 5 - 10 years from now.

A.I. will Help us Bond with the Natural World in a New Fundamental Way

AI might enable us to talk to animals soon, and our identity will change as our senses become extended by A.I.

aisupremacy.substack.com

 

[bnew]

https://www.techopedia.com/can-ais-emerging-translation-tools-help-us-talk-to-animals

Can AI’s Emerging Translation Tools Help Us Talk to Animals?​

Arthur Cole

Technology Writer
|

Fact Checked by Eddie Wrenn
Last updated: 5 October, 2023
Disclosure


KEY TAKEAWAYS

Several projects are underway to devise machine learning and other intelligent models that can decipher animal sounds – everything from whale songs to chicken clucks – to see if they can be interpreted according to how they behave. It is embryonic technology, but more studies are happening as AI becomes more advanced..

In the children’s book “The Story of Doctor Dolittle” by Hugh Lofting, the good doctor is able to penetrate the mysteries of the natural world and human history by talking to animals. It’s never explained exactly how he is able to do this, but it does lead him on many adventures, spawning decades of books, films, and even stage productions.


Now, it seems that data scientists are trying to open similar communications channels with the non-human fauna of planet Earth – using artificial intelligence (AI) as their guide.

Several projects are underway to devise machine learning and other intelligent models that can decipher animal sounds – everything from whale songs to chicken clucks – to see if they can be interpreted according to how they behave.


To date, there have been no breakthroughs of note, and the idea of actually converting human thoughts and expressions into animal “language” is still rather far-fetched.

But, researchers are nonetheless hopeful that by simply fostering a greater understanding of why animals do what they do, conservation and preservation programs can be made more effective.

A Whale of a Conversation​

One of the leading programs is the Cetacean Translation Initiative, aka Project CETI. The group operates out of the Caribbean island of Dominica, where it has set up a massive network of underwater recording devices and has even miked up a number of whales themselves, all in order to collect the data that will be used to train machine learning algorithms in whale-speak.


According to the New Yorker, sperm whales, in particular, have been known to relay numerous kinds of vocalizations for hours at a time, often in repetitive patterns called codas. These patterns differ from one region to another, like human languages do, and baby whales tend to utter random sounds before they, too, start expressing codas. The Ceti project has already identified a number of these codas, but whether any of them qualifies as an actual language is unclear.

Inter-Species Communications​

Another effort, the Earth Species Project, is looking to expand the dialogue to a wider range of animals, including monkeys, birds, and elephants. The idea, says Wired, is that the more we humans understand the natural world, the more awareness we will have of our collective impact, which already has diminished animal populations by 70 percent over the past century.

The group is banking on the idea that new methods of AI translation between human languages might forge a link to animal sounds. Earlier translation bots used a semantic approach to bridge the gap between, say, French and English – basically like looking up words in a dictionary at high speeds. But this approach produced marginal results, at best.

Newer models use a geometric scheme to identify where languages overlap, producing far more accurate translations. If this can improve communications between humans who speak different languages, then why not between humans and animals?

Already, the group has made progress on one of the thornier problems in deciphering animal sounds: determining who is speaking at what time. Whether it’s dolphins at sea or monkeys in the forest canopy, there tends to be a lot of jabbering at once. To counter this, the team has built a neural network that can separate overlapping sounds, although it remains to be tested in the field.

Talking Chicken​

In Japan, meanwhile, research is underway to devise an algorithm that can assess the mental state of chickens based on the way they cluck. At the University of Tokyo, AI models based on existing Deep Emotional Analysis Learning (DEAL) are being used to track the changing vocal patterns of ordinary chickens to see if they reveal if the birds are contented, stressed, hungry, or experiencing any number of other physical or emotional states.

The team, which consists of data scientists, animal psychiatrists, veterinarians, and others, says it has achieved a high success rate, although their findings have not yet been peer-reviewed. If successful, though, the program could produce knowledge that can be used to guide care and feeding practices, housing, and a range of other factors.

At the moment, all of these projects are targeted at improving our understanding of animals and their habitats, with the final aim of alleviating threats to their survival. Understanding their sounds might provide clues as to why dolphins and whales beach themselves, for example, or why groups of chimpanzees wage war on each other.

Bad Intents​

But there is no reason why this cannot be used to increase the exploitation of animals as well. The more we know about animal moods and emotions, the better we can manipulate them and their environments to, say, increase egg or milk production.

Taking it a step further, researcher and author Karen Bakker noted to Scientific-American recently that commercial fishing and even whaling, which is still legal in some parts of the world, can be made more effective if we know what these animals are thinking and can signal them to move to one area or another. There is also the possibility that new ideas or memes could be introduced to entire animal populations, with unknown consequences to their behavior and social structures.

The Bottom Line​

With great power comes great responsibility, of course. Among all the other ways governments across the globe are looking to regulate AI, perhaps equal attention should be paid to its impact on both the natural world and the human world.

But given that there is little consensus, if any, as to how AI should be governed at all, there is not likely to be much movement on its applications in deciphering the animal mind. With luck, however, it will be a while before any of this research bears actual fruit, and as intriguing as it sounds, there will be some rules in place before we, like Dr. Dolittle, can actually talk to the animals.

 

[bnew]

Can AI help us speak to animals? Part two

www.ft.com

Can AI help us speak to animals? Part two​

SEPTEMBER 30 2023

A hardware revolution in recording devices and a software revolution in artificial intelligence has convinced some scientists that humans will eventually be able to ‘translate’ animal and even plant sounds into human language. But what would be the consequences of humans learning to ‘speak whale’, chat with bats or converse with elephants? The FT’s innovation editor John Thornhill and producer Persis Love explore the ethics of potential human-to-animal communication. Presented by John Thornhill, produced by Persis Love, sound design by Breen Turner and Sam Giovinco. The executive producer is Manuela Saragosa. Cheryl Brumley is the FT’s head of audio.

https://sphinx.acast.com/p/acast/s/ftnewsbriefing/e/6509cb9feb820a00110e8eca/media.mp3

 

[bnew]

Scientists Have Reported a Breakthrough In Understanding Whale Language

Researchers have identified new elements of whale vocalizations that they propose are analogous to human speech, including vowels and pitch.

www.vice.com

Scientists Have Reported a Breakthrough In Understanding Whale Language​

Researchers have identified new elements of whale vocalizations that they propose are analogous to human speech, including vowels and pitch.

By Jordan Pearson
December 7, 2023, 10:19am

IMAGE:
REINHARD DIRSCHERL VIA GETTY IMAGES


Researchers have identified previously unknown elements of whale vocalizations that may be analogous to human speech, a new study reports.

Sperm whales are giants of the deep, with healthy adults having no known predators. Scientists studying their vocalizations have already picked out key elements of their communication, namely clicks, sequences of which are called codas. Now, researchers led by Gašper Beuš from the University of California, Berkeley report the discovery that the acoustic properties of these clicks—for example, pitch—are “on many levels analogous to human vowels and diphthongs,” which is when one vowel sound morphs into another such as in the word “coin.” The researchers even identify two unique “coda vowels” that are “actively exchanged” in conversation between whales, which they term the a-vowel and i-vowel.

The researchers explain in their paper, published as a preprint online this week, that the first clue that so-called spectral properties could be meaningful for whale speech was provided by AI. Beuš previously developed a deep learning model for human language called fiwGAN which “was trained to imitate sperm whale codas and embed information into these vocalizations.” Not only did the AI predict elements of whale vocalizations already thought to be meaningful, such as clicks, but it also singled out acoustic properties.

To follow up on the AI’s tip, the researchers analyzed a dataset of 3948 sperm whale codas recorded with hydrophones placed directly on whales between 2014 and 2018. They only analyzed one channel from the hydrophones to control for underwater effects and whale movement, and removed click timing from their visualization to better isolate patterns in the acoustic properties themselves.



These visualizations vindicated the AI’s prediction: The whales reliably exchanged codas with one or two formants—frequency peaks in the sound wave—below the 10kHz range. The researchers termed these codas “vowels,” with single-formant codas being a-vowels and two-formant codas being i-vowels. “This is by analogy to human vowels which differ in their formant frequencies,” the authors wrote. They also identified upward and downward frequency “trajectories” in these codas, which they considered analogous to diphthongs in human language.

Considering that these coda vowel patterns were very distinct and not intermixed, plus the existence of diphthongs, the researchers argue that whales are controlling the frequency of their vocalizations.

“Under our proposed view, whale clicks are equivalent to the pulses of vocal folds in human speech production,” the authors wrote. “In other words, we treat clicks as the source and the sperm whales’ resonant body (the nasal complex, including the spermaceti organ) as the filter that modulates resonant frequencies.”

The analogies to human speech are readily apparent. The authors note, for example, that vocal tone in Mandarin can change the meaning of otherwise identical syllables.

“If our findings are correct, it means that the communication of sperm whales is much more complex and can carry more information than previously thought,” the researchers concluded.

 

[bnew]

Spoiler: thread continued

 

[bnew]

Japanese researchers say they used AI to try and translate the noises of clucking chickens and learn whether they're excited, hungry, or scared

Researchers tested the system on 80 chickens for the study, which was led by a University of Tokyo professor.

www.businessinsider.com

Japanese researchers say they used AI to try and translate the noises of clucking chickens and learn whether they're excited, hungry, or scared​

Beatrice Nolan

Sep 21, 2023, 7:41 AM EDT

The study, which was led by University of Tokyo professor Adrian David Cheok, has yet to be peer-reviewed. Getty Images

• Researchers think they've found a way to use AI to translate the clucks of chickens.
• The Japanese researchers said their AI system could help understand chickens' emotional state.
• The study has not been peer-reviewed and the researchers acknowledged limitations to their methods.

Researchers in Japan said they'd developed an AI system that could understand the emotional state of chickens.

The study, which was led by University of Tokyo professor Adrian David Cheok, has yet to be peer-reviewed.

The AI system is based on a technique the researchers called "Deep Emotional Analysis Learning," which can adapt to changing vocal patterns.

The study found that the system was capable of translating "various emotional states in chickens, including hunger, fear, anger, contentment, excitement, and distress."

The study said: "Our methodology employs a cutting-edge AI technique we call Deep Emotional Analysis Learning (DEAL), a highly mathematical and innovative approach that allows for the nuanced understanding of emotional states through auditory data."

"If we know what animals are feeling, we can design a much better world for them," Cheok told the New York Post. Cheok did not immediately respond to Insider's request for comment, made outside normal working hours.

The researchers tested the system on 80 chickens for the study and collaborated with a team of animal psychologists and veterinarians.

The system was able to achieve surprisingly high accuracy in identifying the birds' emotional states, the study found. "The high average probabilities of detection for each emotion suggest that our model has learned to capture meaningful patterns and features from the chicken sounds," it said.

The researchers acknowledged potential limitations, including variations in breeds and the complexity of some communications, such as body language.

Scientists and researchers are also using AI tools for conservation efforts. In one case, AI tools have been implemented to help identify tracks to better understand animal populations.

In 2022, researchers led by the University of Copenhagen, the ETH Zurich, and France's National Research Institute for Agriculture, Food and Environment said they'd created an algorithm to help understand the emotions of pigs.

 

[Spidey Man]

I hope they didn't figure out how to talk to dogs. I don't need mine snitching to wifey for treats. I also like hamburgers and it would be weird if they talk back