Cloud Hosting

A physical education teacher and former athletic director of a Baltimore County high school has been arrested and charged with using an AI voice cloning service to frame the schools principal.

The Baltimore Banner reports that Baltimore County police believe a recording that circulated on social media in January with purported audio of Pikesville High School principal Eric Eiswert making racist and antisemitic comments was fake. Experts told The Baltimore Banner and police that the recording, which briefly resulted in Eiswerts suspension, has a flat tone, unusually clean background sounds, and lack of consistent breathing sounds or pauses.

Baltimore County police traced the recording to Dazhon Darien, a former athletic director at the school whose name was also mentioned in the audio clip. He allegedly used school computers to access OpenAI tools and Microsoft Bing Chat services, as reported by WBAL-TV 11 and NBC News. He was also linked to the audios release via an email address and associated recovery phone number.

It is not clear what AI voice platform Darien allegedly used.

The police arrested Darien on Thursday at the airport and said in a statement, Its believed Mr. Darien, who was an Athletic Director at Pikesville High School, made the recording to retaliate against Mr. Eiswert who at the time was pursuing an investigation into the potential mishandling of school funds. He has been released after posting bail and faces charges including theft (for the issue with school funds), disturbing the operations of a school, retaliation against a witness, and stalking.

In this fraught environment, OpenAI decided in March to withhold its AI text-to-voice generation platform, Voice Engine, from public use. The service, which only requires a 15-minute audio clip to clone someones voice, is only available to a limited number of researchers due to the lack of guardrails around the technology.

US lawmakers have filed, but not yet passed, several bills like the No Fakes Act and the No AI Fraud Act that seek to prevent technology companies from using an individuals face, voice, or name without their permission.

Update, April 25th: Clarified that Pikesville High School is in the city of Pikesville in Baltimore County, Maryland, and added details about Darien and Thursdays arrest.

The rest is here:

Baltimore coach allegedly used AI voice cloning to get principal fired - The Verge

Divyendra Singh Jadouns phone is ringing off the hook. Known as the Indian Deepfaker, Jadoun is famous for using artificial intelligence to create Bollywood sequences and TV commercials.

But as staggered voting in Indias election begins, Jadoun says hundreds of politicians have been clamoring for his services, with more than half asking for unethical things. Candidates asked him to fake audio of competitors making gaffes on the campaign trail or to superimpose challengers faces onto pornographic images. Some campaigns have requested low-quality fake videos of their own candidate, which could be released to cast doubt on any damning real videos that emerge during the election.

Jadoun, 31, says he declines jobs meant to defame or deceive. But he expects plenty of consultants will oblige, bending reality in the worlds largest election, as more than half a billion Indian voters head to the polls.

The only thing stopping us from creating unethical deepfakes is our ethics, Jadoun told The Washington Post. But its very difficult to stop this.

Indias elections, which began last week and run until early June, offer a preview of how an explosion of AI tools is transforming the democratic process, making it easy to develop seamless fake media around campaigns. More than half the worlds population lives in the more than 50 countries hosting elections in 2024, marking a pivotal year for global democracies.

While its unknown how many AI fakes have been made of politicians, experts say they are observing a global uptick of electoral deepfakes.

I am seeing more [political deepfakes] this year than last year and the ones I am seeing are more sophisticated and compelling, said Hany Farid, a computer science professor at the University of California at Berkeley.

While policymakers and regulators from Brussels to Washington are racing to craft legislation restricting the use of AI-powered audio, images and videos on the campaign trail, a regulatory vacuum is emerging. The European Unions landmark AI Act doesnt take effect until after June parliamentary elections. In the U.S. Congress, bipartisan legislation that would ban falsely depicting federal candidates using AI is unlikely to become law before the November elections. A handful of U.S. states have enacted laws penalizing people who make deceptive videos about politicians, creating a patchwork of policy across the country.

In the meantime, there are limited guardrails to deter politicians and their allies from using AI to dupe voters, and enforcers are rarely a match for fakes that can spread quickly across social media or in group chats. The democratization of AI means its up to individuals like Jadoun not regulators to make ethical choices to stave off AI-induced election chaos.

Lets not stand on the sidelines while our elections get screwed up, Sen. Amy Klobuchar (D-Minn.), who chairs the Senate Rules Committee, said in a speech last month at the Atlantic Council. This is like a hair on fire moment. This is not a lets wait three years and see how it goes moment.

For years, nation-state groups flooded Facebook, Twitter (now X) and other social media with misinformation, emulating the playbook Russia famously used in 2016 to stoke discord in U.S. elections. But AI allows smaller actors to partake, making combating falsehoods a fractured and difficult undertaking.

The Department of Homeland Security warned election officials in a memo that generative AI could be used to enhance foreign-influence campaigns targeting elections. AI tools could allow bad actors to impersonate election officials, DHS said in the memo, spreading incorrect information about how to vote or the integrity of the election process.

These warnings are becoming a reality across the world. State-backed actors used generative AI to meddle in Taiwans elections earlier this year. On election day, a Chinese Communist Party-affiliated group posted AI-generated audio of a prominent politician who dropped out of the Taiwanese election throwing his support behind another candidate, according to a Microsoft report. But the politician, Foxconn owner Terry Gou, had never made such an endorsement, and YouTube pulled down the audio.

Divyendra Singh Jadoun used AI to morph Indian Prime Minister Modis voice into making personalized greetings for the Hindu holiday of Diwali. (Video: Divyendra Singh Jadoun)

Taiwan ultimately elected Lai Ching-te, a candidate whom Chinese Communist Party leadership opposed signaling the limits of the campaign to affect the results of the election.

Microsoft expects China to use a similar playbook in India, South Korea and the United States this year. Chinas increasing experimentation in augmenting memes, videos, and audio will likely continue and may prove more effective down the line, the Microsoft report said.

But the low cost and broad availability of generative AI tools have made it possible for people without state backing to engage in trickery that rivals nation-state campaigns.

In Moldova, AI deepfake videos have depicted the countrys pro-Western president, Maia Sandu, resigning and urging people to support a pro-Putin party during local elections. In South Africa, a digitally altered version of the rapper Eminem endorsed a South African opposition party ahead of the countrys election in May.

In January, a Democratic political operative faked President Bidens voice to urge New Hampshire primary voters to not go to the polls a stunt intended to draw awareness to the problems with the medium.

The rise of AI deepfakes could shift the demographics of who runs for office, because bad actors disproportionately use synthetic content to target women.

For years, Rumeen Farhana, an opposition-party politician in Bangladesh, has faced sexual harassment on the internet. But last year, an AI deepfake photo of her in a bikini emerged on social media.

Farhana said it is unclear who made the image. But in Bangladesh, a conservative majority-Muslim country, the photo drew harassing comments from ordinary citizens on social media, with many voters assuming the photo was real.

Such character assassinations might prevent female candidates from subjecting themselves to political life, Farhana said.

Whatever new things come up, its always used against the women first. They are the victim in every case, Farhana said. AI is not an exception in any way.

In the absence of activity from Congress, states are taking action while international regulators are inking voluntary commitments from companies.

About 10 states have adopted laws that would penalize those who use AI to dupe voters. Last month, Wisconsins governor signed a bipartisan bill into law that would fine people who fail to disclose AI in political ads. And a Michigan law punishes anyone who knowingly circulates an AI-generated deepfake within 90 days of an election.

Yet its unclear if the penalties which include fines of up to $1,000 and up to 90 days of jail time, depending on the municipality are steep enough to deter potential offenders.

With limited detection technology and few designated personnel, enforcers may find it difficult to quickly confirm if a video or image is actually AI-generated.

In the absence of regulations, government officials are seeking voluntary agreements from politicians and tech companies alike to control the proliferation of AI-generated election content. European Commission Vice President Vera Jourova said she has sent letters to key political parties in European member states with a plea to resist using manipulative techniques. However, she said, politicians and political parties will face no consequences if they do not heed her request.

I cannot say whether they will follow our advice or not, she said in an interview. I will be very sad if not because if we have the ambition to govern in our member states, then we should also show we can win elections without dirty methods.

Jourova said that in July 2023 she asked large social media platforms to label AI-generated productions ahead of the elections. The request received a mixed response in Silicon Valley, where some platforms told her it would be impossible to develop technology to detect AI.

OpenAI, which makes the chatbot ChatGPT and image generator DALL-E, has also sought to form relationships with the social media companies to address the distribution of AI-generated political materials. At the Munich Security Conference in February, 20 leading technology companies pledged to team up to detect and remove harmful AI content during the 2024 elections.

This is a whole-of-society issue, Anna Makanju, OpenAI vice president of global affairs, said during a Post Live interview. It is not in any of our interests for this technology to be leveraged in this way, and everyone is quite motivated, particularly because we now have lessons from prior elections and from prior years.

Yet companies will not face any penalties if they fail to live up to their pledge. Already, there have been gaps between OpenAIs stated policies and its enforcement. A super PAC backed by Silicon Valley insiders launched an AI chatbot of long-shot presidential candidate Dean Phillips powered by the companys ChatGPT software, in violation of OpenAIs prohibition political campaigns use of its technology. The company did not ban the bot until The Post reported on it.

Jadoun, who does AI political work for Indias major electoral parties, said the spread of deepfakes cant be solved by government alone citizens must be more educated.

Any content that is making your emotions rise to a next level, he said, just stop and wait before sharing it.

Excerpt from:

AI deepfakes are already hitting elections. We have little protection. - The Washington Post

ABOUT THIS DISTURBING CASE. IT FEELS LIKE REALLY UNCOMFORTABLE. ITS LIKE THE ENVIRONMENT AT THE SCHOOL JUST STARTS TO FEEL HOSTILE, MORE AND MORE LIKE EVERY DAY IM HERE. PIKESVILLE HIGH SCHOOL STUDENTS ARE FRUSTRATED WITH THE SCANDAL AMONGST THEIR SCHOOL LEADERS. THEYVE ALL HEARD THE AUDIO CLIP THAT SOUNDS LIKE THEYRE NOW REMOVED. PIKESVILLE HIGH SCHOOL PRINCIPAL ERIC EISWERTH. THE CLIP, POSTED TO SOCIAL MEDIA, INCLUDES RACIST AND ANTI-SEMITIC INSULTS ABOUT STUDENTS. NOW, COUNTY LEADERS BELIEVE IT WAS A AI GENERATED FROM THE VERY BEGINNING. WE HAVE EXPRESSED OUR CONCERN ABOUT THE DISTURBING AUDIO THAT SHOOK OUR COMMUNITIES HERE IN BALTIMORE COUNTY, DETECTIVES FOUND FORMER ATHLETIC DIRECTOR 31 YEAR OLD DAYS ON DARIAN TO BE RESPONSIBLE FOR THE CLIP. BELIEVED TO BE RETALIATION. AFTER FINDING OUT HIS CONTRACT WOULD NOT BE RENEWED AFTER TERMINATING A COACH WITHOUT APPROVAL AND ALLEGEDLY PAYING TEACHERS UNDER THE TABLE FOR HELPING HIM WITH HIS JOB, WHICH IS THE SUBJECT OF AN INTERNAL AUDIT. I AM UNABLE TO GET INTO SPECIFIC PERSONNEL DETAILS. I CAN TELL YOU THAT WE ARE EXPLORING ADMINISTRATIVE CHANGES, GIVEN THE IMMENSE IMPACT OF THIS INCIDENT ON THE PIKESVILLE HIGH SCHOOL, SCHOOL COMMUNITY AND THE ONGOING LOCAL, NATIONAL AND INTERNATIONAL COVERAGE. CHARGING DOCUMENT STATE THAT AN EDUCATOR ADMITTED TO POLICE. SHE SENT THE CLIP TO NEWS OUTLETS AND A STUDENT WHO SHE KNEW WOULD SPREAD THE CLIP AROUND. DARIAN ORIGINALLY DENIED INVOLVEMENT, BUT POLICE HAVE NOW CONNECTED THE EMAIL ADDRESS THAT SENT OUT THE AUDIO CLIP TO DARIENS GRANDMOTHERS HOME IN LA, WITH THE RECOVERY PHONE NUMBER BEING DARIENS PHONE. POLICE ALSO HAD MULTIPLE EXPERTS CONFIRMED TRACES OF AI WITH HUMAN EDITING IN THE CLIP, AND FOUND THAT DARIAN HAD EVEN USED THE SCHOOL NETWORK TO SEARCH FOR AI TOOLS. ALL THIS LEADING TO HIS ARREST AT BWI. WHEN ATTEMPTING TO BOARD A FLIGHT THURSDAY MORNING. HES NOW CHARGED WITH THEFT, DISRUPTION OF SCHOOL ACTIVITIES, RETALIATION, AND STALKING. MEANTIME, THE INVESTIGATION INTO THE OTHER EDUCATORS POSSIBLY INVOLVED THAT IS ONGOING AT PIKESVIL

Police: Purported recording of Pikesville HS principal was not authentic, contained AI content

School's former athletic director arrested at BWI-Marshall Airport on open warrant

Updated: 6:08 PM EDT Apr 25, 2024

The former athletic director at Pikesville High School has been arrested in connection to an AI-generated impersonation of the school's principal.Dazhon Darien, 31, faces multiple charges, including stalking, theft, disruption of school operations, and retaliation against a witness, according to charging documents obtained by 11 News.The investigationPolice said the charges are connected to an investigation that started on Jan. 17 into a voice recording circulated on social media that was alleged to have been the voice of the school's principal, Eric Eiswert.Police said the audio clip, which was an alleged race-based commentary on the school's students and teachers, was spread on social media. That led to the temporary removal of Eiswert from the school, as well as many hate-filled messages on social media and numerous calls to the school."From the very beginning, we have expressed our concern about the disturbing audio that shook our communities here in Baltimore County," Baltimore County Executive Johnny Olszewski said.Police: Recording was not authenticPolice said Thursday afternoon that detectives have conclusive evidence based on a forensic analysis by the FBI that the recording was not authentic. Police said the analysis indicated the recording contained traces of AI-generated content. Detectives then sought an additional analysis by the University of California, Berkley, which arrived at the same findings as the FBI's analysis.Police said investigators believe Darien made the recording to retaliate against Eiswert, who, at the time, was pursuing an investigation into the potential mishandling of school funds. From the day the audio clip went out, Eiswert told detectives he had an idea of who was behind it. The charging documents state that Eiswert believed Darien was responsible for the clip because he believed Darien was tech-savvy and familiar with AI, and a grievance was fueled by Darien's contract not being renewed due to work-performance issues that included terminating a coach without approval and allegedly paying teachers under the table for helping him with his job, which is the subject of an internal audit."While I am unable to get into specific personnel details, we are exploring administrative changes given the immense impact of this incident on the Pikesville High School community and the local, national and international coverage," Baltimore County Public Schools Superintendent Myriam Rogers said.Video below: Full news conferencePolice said Darien had used the school network to search for AI tools. While Darien originally denied involvement, police have since connected an email address that sent out the audio clip to Darien's grandmother's home in Los Angeles that has a recovery phone number being Darien's own cellphone.Others were involvedPolice said the audio clip was originally sent to a friend group of three teachers. One of the educators admitted to police she sent the clip to news outlets and a student who she knew would spread the clip.An investigation into the other teachers involved continues.Baltimore County leaders addressed the scandal in the school district in a news conference Thursday afternoon."As you can imagine, this has been a very difficult time for Pikesville High School community, Principal Eiswert and his family and team BCPS," Rogers said.Pikesville students expressed frustration with the scandal amongst their school leaders."It feels really uncomfortable. The environment at the school starts to feel hostile more and more every day as I'm here," said Julian Solomon, a Pikesville senior.Defendant arrested at airportDarien was apprehended Thursday at Baltimore-Washington International Thurgood Marshall Airport, while he was en route to Houston."Officers with the Maryland Transportation Authority took Mr. Darien into custody this morning at BWI-Thurgood Marshall Airport as he was attempting to board a flight," Baltimore County Police Chief Robert McCullough said.The police chief could not say whether Darien was attempting to flee."He could have been simply going there for other purposes," McCullough said.The chief did say Darien had a firearm, which alerted Maryland Transportation Authority police because of the way the firearm was packaged for transport. MDTA police then detained Darien after discovering the warrant out for his arrest in the Pikesville case. Prosecutor: This appears to be a first-of-its-kind caseBaltimore County State's Attorney Scott Shellenberger said the case appears to one of the first of its kind nationwide that his office was able to find. He said the Maryland General Assembly may need to update state laws to catch up with the nefarious possibilities of the new technology. For example, the charge of disrupting school activities "only carries a six-month sentence," Shellenberger said. "But we also need to take a broader look at how this technology can be used and abused to harm other people."Following a court appearance Thursday afternoon, Darien was released on a $5,000 unsecured bond. A check of online court records for Darien did not list an attorney who might be able to speak on his behalf Thursday.BCPS statementBaltimore County Public Schools sent an email to its community, which follows below.I am writing to provide an important update on the Pikesville High School investigation. This morning, Baltimore County police officers arrested Dazhon Darien, the Pikesville High School athletic director, on multiple charges stemming from an investigation the Baltimore County Police Department launched in reference to the Jan. 17, 2024, release of an audio recording allegedly of Principal Eric Eiswert. This afternoon, I joined the county executive, chief of police, and the state's attorney for a joint press conference so that the police could provide an update on the investigation and I could address next steps for the Pikesville High School community and Team BCPS. When we were made aware of the recording, we immediately launched an investigation and solicited the help of the county executive, Baltimore County police, and additional external experts. Baltimore County police enlisted the services of the Federal Bureau of Investigation. We collaborated with these partners because they have the resources and skill to determine the authenticity of the recording, and they have verified that Mr. Darien used artificial intelligence to create the audio recording. In light of today's announcement by the police department and as required by state education law we are taking appropriate action regarding Mr. Darien's conduct, up to and including a recommendation for termination. We have also been made aware that other BCPS employees are named in the charging documents. The BCPS Office of Human Resources will follow all system procedures for investigating their involvement and we will take swift action in alignment with their rights under the established collective bargaining agreement, board policy and state law.We want to thank County Executive Johnny Olszewski, Chief of Police Robert McCullough, State's Attorney Scott Shellenberger and our law enforcement partners for their work over the last several months. While law enforcement investigated, our focus as a system remained on providing direct support to Pikesville High School students and staff and creating safe spaces for them to process this incident, while maintaining our unwavering commitment to teaching and learning. This has been a difficult time for the Pikesville High School community, Principal Eiswert and his family and Team BCPS. We are proud of the students and staff and how they have stepped up to support one another. As I stated previously, the statements that were made in the recording do not reflect the core values of our system. We are proud of the diversity of Baltimore County Public Schools and strive to ensure that each member of Team BCPS feels valued and has a sense of belonging.We can now shift our focus to moving forward and providing all parties with a fresh start. While we are unable to provide specific personnel-related details, it is important to note that we are exploring administrative changes given the immense impact of this incident on the Pikesville High School community and the ongoing local, national and international coverage. To ensure continuity for our students, Mrs. Kyria Joseph, executive director of high schools, and Dr. George Roberts, consulting administrator, will continue to serve the Pikesville High School community as lead administrators for the remainder of the school year. We will work with Principal Eiswert and the Pikesville community concerning next school year.BCPS student support services team members will be available Friday, April 25, 2024, and on Monday, April 28, 2024, to engage Pikesville High School students in conversations as they process this information. We also encourage parents and families to engage in an open dialogue with their children.Resources to support parents and families include:Assisting parents caregivers in coping with collective traumas (PDF)Resources that are available to BCPS staff and the community:BCPS Employee Assistance ProgramTalkspace: Free online therapy for high school students in BaltimoreBaltimore County Crisis Response: Call 410-931-2214National Suicide Prevention Lifeline: Call 988Crisis text line: Text the word "HOME" to 741741 for free 24-hour support211 Maryland: Call 211We also want to encourage Pikesville High School students to speak with school support staff (i.e., counselors, social worker, psychologist) and trusted adults. Parents and caretakers are welcome to reach out to staff if they need support for their student. Thank you for your patience and support as we worked through the investigative process with law enforcement. We hope that today's update can provide some sense of closure to the community, and we look forward to our continued partnership to ensure the Pikesville High School community and Team BCPS end this school year strong.The Associated Press contributed to this report.

The former athletic director at Pikesville High School has been arrested in connection to an AI-generated impersonation of the school's principal.

Dazhon Darien, 31, faces multiple charges, including stalking, theft, disruption of school operations, and retaliation against a witness, according to charging documents obtained by 11 News.

Police said the charges are connected to an investigation that started on Jan. 17 into a voice recording circulated on social media that was alleged to have been the voice of the school's principal, Eric Eiswert.

Police said the audio clip, which was an alleged race-based commentary on the school's students and teachers, was spread on social media. That led to the temporary removal of Eiswert from the school, as well as many hate-filled messages on social media and numerous calls to the school.

"From the very beginning, we have expressed our concern about the disturbing audio that shook our communities here in Baltimore County," Baltimore County Executive Johnny Olszewski said.

Police said Thursday afternoon that detectives have conclusive evidence based on a forensic analysis by the FBI that the recording was not authentic. Police said the analysis indicated the recording contained traces of AI-generated content. Detectives then sought an additional analysis by the University of California, Berkley, which arrived at the same findings as the FBI's analysis.

Police said investigators believe Darien made the recording to retaliate against Eiswert, who, at the time, was pursuing an investigation into the potential mishandling of school funds.

From the day the audio clip went out, Eiswert told detectives he had an idea of who was behind it. The charging documents state that Eiswert believed Darien was responsible for the clip because he believed Darien was tech-savvy and familiar with AI, and a grievance was fueled by Darien's contract not being renewed due to work-performance issues that included terminating a coach without approval and allegedly paying teachers under the table for helping him with his job, which is the subject of an internal audit.

"While I am unable to get into specific personnel details, we are exploring administrative changes given the immense impact of this incident on the Pikesville High School community and the local, national and international coverage," Baltimore County Public Schools Superintendent Myriam Rogers said.

Video below: Full news conference

Police said Darien had used the school network to search for AI tools. While Darien originally denied involvement, police have since connected an email address that sent out the audio clip to Darien's grandmother's home in Los Angeles that has a recovery phone number being Darien's own cellphone.

Police said the audio clip was originally sent to a friend group of three teachers. One of the educators admitted to police she sent the clip to news outlets and a student who she knew would spread the clip.

An investigation into the other teachers involved continues.

Baltimore County leaders addressed the scandal in the school district in a news conference Thursday afternoon.

"As you can imagine, this has been a very difficult time for Pikesville High School community, Principal Eiswert and his family and team BCPS," Rogers said.

Pikesville students expressed frustration with the scandal amongst their school leaders.

"It feels really uncomfortable. The environment at the school starts to feel hostile more and more every day as I'm here," said Julian Solomon, a Pikesville senior.

Darien was apprehended Thursday at Baltimore-Washington International Thurgood Marshall Airport, while he was en route to Houston.

"Officers with the Maryland Transportation Authority took Mr. Darien into custody this morning at BWI-Thurgood Marshall Airport as he was attempting to board a flight," Baltimore County Police Chief Robert McCullough said.

The police chief could not say whether Darien was attempting to flee.

"He could have been simply going there for other purposes," McCullough said.

The chief did say Darien had a firearm, which alerted Maryland Transportation Authority police because of the way the firearm was packaged for transport. MDTA police then detained Darien after discovering the warrant out for his arrest in the Pikesville case.

Baltimore County State's Attorney Scott Shellenberger said the case appears to one of the first of its kind nationwide that his office was able to find. He said the Maryland General Assembly may need to update state laws to catch up with the nefarious possibilities of the new technology.

For example, the charge of disrupting school activities "only carries a six-month sentence," Shellenberger said. "But we also need to take a broader look at how this technology can be used and abused to harm other people."

Following a court appearance Thursday afternoon, Darien was released on a $5,000 unsecured bond. A check of online court records for Darien did not list an attorney who might be able to speak on his behalf Thursday.

Baltimore County Public Schools sent an email to its community, which follows below.

Resources to support parents and families include:

Resources that are available to BCPS staff and the community:

The Associated Press contributed to this report.

Excerpt from:

Police: Purported recording of principal contained AI content - WBAL TV Baltimore