In December 2020, public controversy erupted over the circumstances surrounding Gebru's departure from Google, where she was technical co-lead of the Ethical Artificial Intelligence Team. Gebru had coauthored a paper on the risks of large language models (LLMs) acting as stochastic parrots, and submitted it for publication. According to Jeff Dean, the paper was submitted without waiting for Google's internal review, which then concluded that it ignored too much relevant research. Google management requested that Gebru either withdraw the paper or remove the names of all the authors employed by Google. Gebru requested the identity and feedback of every reviewer, and stated that if Google refused she would talk to her manager about "a last date". Google terminated her employment immediately, stating that they were accepting her resignation. Gebru maintained that she had not formally offered to resign, and only threatened to.[4]
Gebru has been recognized widely for her expertise in the ethics of artificial intelligence. She was named one of the World's 50 Greatest Leaders by Fortune and one of Nature's ten people who shaped science in 2021, and in 2022, one of Time's most influential people.
Early life and education
Gebru was raised in Addis Ababa, Ethiopia.[5] Her father, an electrical engineer with a Doctor of Philosophy (PhD), died when she was five years old, and she was raised by her mother, an economist.[6][7] Both her parents are from Eritrea. When Gebru was 15, during the Eritrean–Ethiopian War, she fled Ethiopia after some of her family were deported to Eritrea and compelled to fight in the war. She was initially denied a U.S. visa and briefly lived in Ireland, but she eventually received political asylum in the U.S.,[7][8] an experience she said was "miserable". Gebru settled in Somerville, Massachusetts, to attend high school, where she says she immediately started to experience racial discrimination, with some teachers refusing to allow her to take certain Advanced Placement courses, despite being a high-achiever.[9][7]
After she completed high school, an encounter with the police set Gebru on a course toward a focus on ethics in technology. A friend of hers, a Black woman, was assaulted in a bar, and Gebru called the police to report it. She says that instead of filing the assault report, her friend was arrested and remanded to a cell. Gebru called it a pivotal moment and a "blatant example of systemic racism."[9]
Gebru presented her doctoral research at the 2017 LDV Capital Vision Summit competition, where computer vision scientists present their work to members of industry and venture capitalists. Gebru won the competition, starting a series of collaborations with other entrepreneurs and investors.[13][14]
Both during her PhD program in 2016 and in 2018, Gebru returned to Ethiopia with Jelani Nelson's programming campaign AddisCoder.[15][16]
While working on her PhD, Gebru authored a paper that was never published about her concern over the future of AI. She wrote of the dangers of the lack of diversity in the field, centered on her experiences with the police and on a ProPublica investigation into predictive policing, which revealed a projection of human biases in machine learning.[9] In the paper, she scathed the "boy's club culture", reflecting on her experiences at conference gatherings of drunken male attendees sexually harassing her, and criticized the hero worship of the field's celebrities.[7]
Career
Gebru discussing her findings that one can predict, with some reliability, the way an American will vote from the type of vehicle they drive
2004–2013: Software development at Apple
Gebru joined Apple as an intern while at Stanford, working in their hardware division making circuitry for audio components, and was offered a full-time position the following year. Of her work as an audio engineer, her manager told Wired she was "fearless", and well-liked by her colleagues. During her tenure at Apple, Gebru became more interested in building software, namely computer vision that could detect human figures.[7] She went on to develop signal processing algorithms for the first iPad.[17] At the time, she said she did not consider the potential use for surveillance, saying "I just found it technically interesting."[7]
Long after leaving the company, during the #AppleToo movement in the summer of 2021, which was led by Apple engineer Cher Scarlett, who consulted with Gebru,[18][19][20] Gebru revealed she experienced "so many egregious things" and "always wondered how they manage[d] to get out of the spotlight."[21] She said that accountability at Apple was long overdue, and warned they could not continue to fly under the radar for much longer.[22] Gebru also criticized the way the media covers Apple and other tech giants, saying that the press helps shield such companies from public scrutiny.[20]
2013–2017: Research at Stanford and Microsoft
In 2013, Gebru joined Fei-Fei Li's lab at Stanford. She used data mining of publicly available images.[12] She was interested in the amount of money spent by governmental and non-governmental organisations trying to collect information about communities.[23] To investigate alternatives, Gebru combined deep learning with Google Street View to estimate the demographics of United States neighbourhoods, showing that socioeconomic attributes such as voting patterns, income, race, and education can be inferred from observations of cars.[10] If the number of pickup trucks outnumbers the number of sedans, the community is more likely to vote for the Republican party.[24] They analysed over 15 million images from the 200 most populated U.S. cities.[25] The work was extensively covered in the media, being picked up by BBC News, Newsweek, The Economist, and The New York Times.[26][27][28]
In 2015, Gebru attended the field's top conference, Neural Information Processing Systems (NIPS), in Montreal, Canada. Out of 3,700 attendees, she noted she was one of only a few Black researchers.[29] When she attended again the following year, she kept a tally and noted that there were only five Black men and that she was the only Black woman out of 8,500 delegates.[7] Together with her colleague Rediet Abebe, Gebru founded Black in AI, a community of Black researchers working in artificial intelligence.[30]
In the summer of 2017, Gebru joined Microsoft as a postdoctoral researcher in the Fairness, Accountability, Transparency, and Ethics in AI (FATE) lab.[7][25][31] In 2017, Gebru spoke at the Fairness and Transparency conference, where MIT Technology Review interviewed her about biases that exist in AI systems and how adding diversity in AI teams can fix that issue. In her interview with Jackie Snow, Snow asked Gebru, "How does the lack of diversity distort artificial intelligence and specifically computer vision?" and Gebru pointed out that there are biases that exist in the software developers.[32] While at Microsoft, Gebru co-authored a research paper called Gender Shades,[9] which became the namesake of a project of a broader Massachusetts Institute of Technology project led by co-author Joy Buolamwini. The pair investigated facial recognition software, finding that in one particular implementation Black women were 35% less likely to be recognized than White men.[33]
2018–2020: Artificial intelligence ethics at Google
Gebru joined Google in 2018, where she co-led a team on the ethics of artificial intelligence with Margaret Mitchell. She studied the implications of artificial intelligence, looking to improve the ability of technology to do social good.[34]
In 2019, Gebru and other artificial intelligence researchers "signed a letter calling on Amazon to stop selling its facial-recognition technology to law enforcement agencies because it is biased against women and people of color", citing a study that was conducted by MIT researchers showing that Amazon's facial recognition system had more trouble identifying darker-skinned females than any other technology company's facial recognition software.[35] In a New York Times interview, Gebru has further expressed that she believes facial recognition is too dangerous to be used for law enforcement and security purposes at present.[36]
Exit from Google
In 2020 Gebru and five co-authors wrote a paper titled "On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜". The paper examined risks of very large language models, including their environmental footprint, financial costs, the inscrutability of large models, the potential for LLMs to display prejudice against certain groups, the inability of LLMs to understand the language they process, and the use of LLMs to spread disinformation.[37]
In December 2020, her employment with Google ended after Google management asked her to either withdraw the paper before publication, or remove the names of all the Google employees from the paper.[1] Of the six authors, only Emily M. Bender was not at the time employed at Google.[37] In a six-page mail sent to an internal collaboration list, Gebru describes how she was summoned to a meeting at short notice where she was asked to withdraw the paper and she requested to know the names and reasons of everyone who made that decision, along with advice for how to revise it to Google's liking. She said she would work with Google on an employment end date after an appropriate amount of time if not provided with that information.[1][9][7] Google did not meet her request and terminated her employment immediately, declaring that they accepted her resignation.[38]Jeff Dean, Google's head of AI research, replied with an email saying that they made the decision because the paper ignored too much relevant recent research on ways to mitigate some of the problems described in it, about environmental impact, and bias of these models.[39][9]
Dean went on to publish his internal email regarding Gebru's departure and his thoughts on the matter, defending Google's research paper process to "tackle ambitious problems, but to do so responsibly." Gebru and others blame this initial publication, and Dean's subsequent silence on the matter, which Gebru says have both catalyzed and enabled harassment that followed close behind his response. Gebru was serially harassed by a number of sock puppet accounts and internet trolls on Twitter, making racist and obscene comments. Gebru and her supporters alleged that some of the harassment came from machine learning researcher Pedro Domingos and businessman Michael Lissack, who had said that her work was "advocacy disguised as science".[40][41] Lissack also allegedly harassed Mitchell and Bender, along with other colleagues on Gebru's former team. Twitter temporarily suspended Lissack's account access on 1 February 2021.[42]
Gebru has repeatedly maintained that she was fired, and close to 2,700 Google employees and more than 4,300 academics and civil society supporters signed a letter condemning Gebru's alleged firing.[43][44] Nine members of Congress sent a letter to Google asking it to clarify the circumstances around Timnit Gebru's exit.[45] Gebru's former team demanded that Vice President Megan Kacholia be removed from the team's management chain.[46] Kacholia had allegedly fired Gebru without notifying Gebru's direct manager Samy Bengio first,[47] and Gebru's former team demanded Kacholia and Dean apologize for how Gebru was treated.[48] Mitchell took to Twitter to criticize Google's treatment of employees working to eliminate bias and toxicity in AI, including its alleged dismissal of Gebru. Mitchell was later terminated for alleged exfiltration of confidential business-sensitive documents and private data of other employees.[49][50]
Following the negative publicity over the circumstances of her exit, Sundar Pichai, CEO of Alphabet, Google's parent company, publicly apologized on Twitter without clarifying whether Gebru was terminated or resigned[51] and initiated a months-long investigation into the incident.[49][52] Upon conclusion of the review, Dean announced Google would be changing its "approach for handling how certain employees leave the company", but still did not clarify whether or not Gebru's leaving Google was voluntary.[49] Additionally, Dean said there would be changes to how research papers with "sensitive" topics would be reviewed, and diversity, equity, and inclusion goals would be reported to Alphabet's board of directors quarterly. Gebru wrote on Twitter that she "expected nothing more" from Google and pointed out that the changes were due to the requests she was allegedly terminated for but that no one was held accountable for it.[53] In the aftermath, two Google employees resigned from their positions at the company.[54]
Following her departure, Google held a forum to discuss experiences with racism at the company, and employees reported to NBC News that half of it was spent discrediting Gebru, which they took as the company making an example of her for speaking out. The forum was followed up with a group psychotherapy session for Google's Black employees with a licensed therapist, which the employees said was dismissive over the harm they felt Gebru's alleged termination had caused.[55]
Since 2021: Independent research
In November 2021, the Nathan Cummings Foundation, partnered with Open MIC and endorsed by Color of Change,[56] filed a shareholder proposal calling for a "racial equity audit" to analyze Alphabet's "adverse impact" on "Black, Indigenous and People of Color (BIPOC) communities". The proposal also requests investigation into whether or not Google retaliated against minority employees who raised concerns of discrimination,[57] citing Gebru's firing, her previous urge for Google to hire more BIPOC, and her research into racially based biases in Google's technology.[58][59] The proposal followed a less formal request from a group of Senate Democratic Caucus members led by Cory Booker from earlier that year, also citing Gebru's separation from the company and her work.[60]
In December 2021, Reuters reported that Google was under investigation by California Department of Fair Employment and Housing (DFEH) for its treatment of Black women,[61] after numerous formal complaints of discrimination and harassment by current and former workers.[59][62] The probe comes after Gebru, and other BIPOC employees, reported that when they brought up their experiences with racism and sexism to Human Resources, they were advised to take medical leave and therapy through the company's Employee Assistance Program (EAP).[55] Gebru, and others, believe that her alleged dismissal was retaliatory and evidence that Google is institutionally racist.[63] Google said that it "continue[s] to focus on this important work and thoroughly investigate[s] any concerns, to make sure [Google] is representative and equitable."[61]
In June 2021, Gebru announced that she was raising money to "launch an independent research institute modeled on her work on Google's Ethical AI team and her experience in Black in AI."[7]
On 2 December 2021 she launched the Distributed Artificial Intelligence Research Institute (DAIR), which is expected to document the effect of artificial intelligence on marginalized groups, with a focus on Africa and African immigrants in the United States.[64][65] One of the organization's initial projects plans to analyze satellite imagery of townships in South Africa with AI to better understand legacies of apartheid.[9]
Gebru, Buolamwini, and Inioluwa Deborah Raji won VentureBeat's 2019 AI Innovations Award in the category AI for Good for their research highlighting the significant problem of algorithmic bias in facial recognition.[69][70] Gebru was named one of the world's 50 greatest leaders by Fortune in 2021.[71] Gebru was included in a list of ten scientists who had had important roles in scientific developments in 2021 compiled by the scientific journal Nature.[72]
Gebru was named one of Time's most influential people of 2022.[73]
^ abcdMetz, Cade; Wakabayashi, Daisuke (3 December 2020). "Google Researcher Says She Was Fired Over Paper Highlighting Bias in A.I."The New York Times. Archived from the original on 11 December 2020. Retrieved 12 December 2020. After she and the other researchers submitted the paper to an academic conference, Dr. Gebru said, a Google manager demanded that she either retract the paper from the conference or remove her name and the names of the other Google employees. She refused to do so without further discussion and, in the email sent Tuesday evening, said she would resign after an appropriate amount of time if the company could not explain why it wanted her to retract the paper and answer other concerns. The company responded to her email, she said, by saying it could not meet her demands and that her resignation was accepted immediately. Her access to company email and other services was immediately revoked. In his note to employees, Mr. Dean said Google respected "her decision to resign". Mr. Dean also said that the paper did not acknowledge recent research showing ways of mitigating bias in such systems.
^"Timnit Gebru". World Science Festival. Archived from the original on 10 January 2019. Retrieved 9 January 2019.
^Mitchell, Margaret; Wu, Simone; Zaldivar, Andrew; Barnes, Parker; Vasserman, Lucy; Hutchinson, Ben; Spitzer, Elena; Raji, Inioluwa Deborah; Gebru, Timnit (2019). "Model Cards for Model Reporting". Proceedings of the Conference on Fairness, Accountability, and Transparency. New York, New York, US: ACM Press. pp. 220–229. arXiv:1810.03993. doi:10.1145/3287560.3287596. ISBN978-1-4503-6125-5. S2CID52946140.
^University, Office of Web Communications, Cornell. "Digital Life Seminar | Timnit Gebru". Cornell. Archived from the original on 10 January 2019. Retrieved 9 January 2019.{{cite web}}: CS1 maint: multiple names: authors list (link)
^Allyn, Bobby (17 December 2020). "Ousted Black Google Researcher: 'They Wanted To Have My Presence, But Not Me Exactly'". NPR. Archived from the original on 18 December 2020. Retrieved 19 December 2020. After Google demanded that Gebru retract the paper for not meeting the company's bar for publication, Gebru asked that the process be explained to her, including a list of everyone who was part of the decision. If Google refused, Gebru said she would talk to her manager about "a last date." Google took that to mean Gebru offered to resign immediately, and Google leadership say they accepted, but Gebru herself said no such offer was ever extended, only threatened.
^Goforth, Claire (3 February 2021). "Men in tech are harassing Black female computer scientist after her Google ouster". Daily Dot. Archived from the original on 4 February 2021. Retrieved 4 February 2021. Gebru's departure from Google, where she was co-lead of the ethical artificial intelligence (AI) team, was precipitated by a paper she co-authored. ... At the last minute, Google refused to allow the paper to be published with its name on it. Gebru drew a line in the sand, saying she'd only comply if certain conditions were met; otherwise, she'd resign, Technology Review reports. The company swiftly responded by saying it accepted her resignation.
