Interdisciplinary researcher focused on shaping AI towards long-term positive goals. ML & Ethics. Similar content in the Skies (this bird has flown).

I abruptly lost my job 9 days ago. Tomorrow I lose my healthcare. This is the "view from the top" for a successful female AI research scientist who has built her career for over 15 years.
422
3,044
28,323
I'm fired.
750
1,336
7,634
Marie Curie was the first woman to win the Nobel Prize. This didn't happen because she herself fought for it -- although she did fight hard the whole way to even get to that point. 👩‍🔬 What happened was that the award was offered to her husband, Pierre. (1/n) 🧵
Congratulations to our 2024 medicine laureate Victor Ambros ✨ This morning he celebrated the news of his prize with his colleague and wife Rosalind Lee, who was also the first author on the 1993 'Cell' paper cited by the Nobel Committee. #NobelPrize
30
1,020
5,513
655,018
At Google, female research scientist women were blocked when they tried to hire other female research scientist women. The reason given, on multiple occasions, was that we were trying to hire "our friends". Shall we unpack this with respect to how sexist discrimination works?
20
837
5,023
I replicated this (my screenshot below). Really great example of gender bias, for those of you who need a canonical example to make the point.
89
810
3,080
885,604
Reflecting on Claudine Gay, I'm reminded that a fundamental of racism--that we should all be aware of--is the disparate application of rules: People from one race* are disproportionately punished for "breaking a rule" that ppl from another are virtually never punished for.🧵
663
515
2,889
445,508
Either Nvidia has *no* Spanish speakers, or there's a Spanish speaker in a position of a lot of power having a chuckle...
Introducing NVIDIA cuLitho, a new software library that brings accelerated computing to computational #lithography, delivering a 40X performance leap while running on #GPUs. #GTC23
45
392
3,112
549,146
Meanwhile, over in Google Search. Andrew Johnson has been killin it, I never knew.
66
383
2,557
598,284
Pierre refused to accept unless it were also extended to Marie -- his wife, but also his coworker and fellow scientist. Together, they made fundamental advances. And so Marie Curie became the first female to break the Nobel Prize barrier... (2/n)
4
129
2,426
49,816
It seems that women alone can only do so much. Especially if they're <10% of a scientific field. Things will really start to change when men are actively looking out for women, fighting hard for gender equality even more so than their female peers. (4/n)
6
145
2,027
51,797
Personal news! I'm joining Hugging Face 🤗. It's a community creating transparent AI models that are now powering both private and public AI, so exactly where I should be to move AI forward from its very foundations. =) Thanks to @dinabass for covering! bloomberg.com/news/articles/…
103
144
2,045
Okay, @60Minutes is saying that Google's Bard model "spoke in a foreign language it was never trained to know." I looked into what this can mean, and it appears to be a lie. Here's the evidence, curious what others found. 🧵
51
539
1,822
1,097,771
In order to understand why ChatGPT can't replace Google Search, it's useful to understand the early days of web search and the role that PageRank played. 1/n
48
319
1,928
736,392
Fwiw @ journalists: I worked hard for years to motivate and create the Ethical AI team and the ML Fairness focus at Google. Google did not create these orgs and invite @timnitGebru to lead; I did. Please do not erase me anymore. Thanks. ♥️
6
205
1,575
To everyone who's reached out, thanks! To everyone I've worked with closely for 4 years, I've loved you as work family, thank you for working w/ & believing in me. I tried to raise concerns about race & gender inequity, and speak up about Google’s problematic firing of Dr. Gebru.
28
95
1,507
...Sharing the award in quarters with her husband (The other half of the award went to Antoine Henri Becquerel). (3/n)
2
42
1,358
42,732
I've been explaining how, for Computer Scientist women, picking up more skills means the others are erased & you're further demeaned. I started programming at ~10. Trained my first model when I was ~21 (without ML packages). Worked in "AI" for ~15 years. I have a doctorate in CS.
Replying to @npparikh
Let’s start with this. What’s a model?
24
111
1,307
623,877
Hello, world! Similar to @timnitGebru, I abruptly lost access to my professional calendar. Any upcoming talks, deadlines, and entities involved, are no longer accessible to me. I am sending this broad, mass message, asking anyone expecting something from me to please let me know!
27
206
1,330
So....this happened. !!! I'm under "Pioneers" 🥰 time.com/collection/100-most…
111
99
1,268
217,103
Pro tip: if a machine learned model scores 100% on something, the metric is wrong, or the evaluation dataset is not robust, or the evaluation dataset is in the training data, or a combination of all of the above. At least in this point in time.
45
155
1,078
219,818
NY Times puts out a piece of "who's who" who has worked a decade+ to advance AI that, amazingly, is only men. That's intentional, right? It's legitimately hard to do that. Fwiw, I've worked well over a decade on AI. I actually even won the "decade test of time" award last year...
40
202
1,065
280,862
I don't think tech companies are testing coding in the right way...The main skill that I've seen to be important is the ability to jump into *someone else's* code and, e.g., fix a bug, implement a new function. The ability to fluently read code that's not yours is critical.
40
126
1,083
Actually, Google has demonstrated they're not capable of basic self-regulation. I say this as someone who worked hard on establishing mechanisms for self-regulation *at* Google. This included Model Cards (now common in industry) and basic due diligence on the tech. (1/2)
WATCH: Former Google CEO @ericschmidt tells #MTP Reports the companies developing AI should be the ones to establish industry guardrails — not policy makers. “There’s no way a non-industry person can understand what’s possible.”
27
246
1,008
201,533
Gday world. Entering week 5 of being locked out of work after witnessing something very wrong, wrought by my superiors, targeting @timnitGebru. Exhausted by the endless degradation to save face for the Upper Crust in tech at the expense of minorities' life-long careers.
19
196
1,012
"didn’t meet our bar for publication ... It ignored too much relevant research". He says of our paper, with over 128 cross-discipline citations. And so fires one of the authors. 2020's monster version of Reviewer #2.
I understand the concern over Timnit’s resignation from Google. She’s done a great deal to move the field forward with her research. I wanted to share the email I sent to Google Research and some thoughts on our research process. docs.google.com/document/d/1…
9
152
917
Dudes. There is no such thing as an "unbiased" or "debiased" dataset. Stop presenting like that's a real thing. It's really frigging destructive to legitimate academic debate on bias in ML.
22
138
911
SOMEONE IN US CONGRESS WANTS TO TALK TO ME ABOUT AI STUFF!! Thanks for your support everyone. 🥲 Wish me luck.
46
35
911
55,247
Last week, a major AI milestone was hit: the BLOOM model was released, for everyone (including you!) to examine. What is this, and why is this important? 🧵👇 huggingface.co/bigscience/bl…
9
223
845
For more on this, and concrete suggestions, please see this piece I penned one angry evening in August 2016: m-mitchell.com/gender/papers… As it was then...so it is now.
3
37
797
44,028
Yeah. End of week 5. I'm in too much pain to articulate much of anything useful. Firing @timnitGebru created a domino effect of trauma for me and the rest of the team, and I believe we are being increasingly punished for that trauma.
Replying to @dinabass
And in case anyone is keeping track of the things Google is trying to resolve here, @mmitchell_ai, who co-led the research team on Ethical AI at Google with Gebru, is, as far as I know, still locked out of her email and corporate systems.
11
147
751
Just said "no" to a 6:30 am Monday meeting to "explore synergies". I have 0 synergies that can be explored Monday 6:30am. Utterly Synergiless.
16
37
749
A lot of mixed feelings about what's being reported in this great article from @nitashatiku; everything from my appreciation of @cajundiscordian, to my anger@ a few ppl in Google leadership, to my position as a relatively advanced researcher in this field. washingtonpost.com/technolog…
23
170
732
2. The cognitive bias of "Gender Bias" includes assuming women are less capable at technical tasks. This may take the form of assuming -- and projecting, à la confirmation bias -- that they are not qualified for tasks they are qualified for. Here's a related xkcd comic.
3
97
697
In Silicon Valley culture, the groupthink seems to be that it's impossible to keep track of the data a language model is trained on, yet it *is* possible to solve artificial general intelligence. This requires a reality distortion that blends myopia with narcissism.
One component of transparency in ML oversight is: "what data was the model trained on". It seems like this would be impossible to answer for LLMs, (and might very well be), but the fascinating thread below shows why the answer to this question is important: 1/n
19
122
711
177,970
I'm consulting for a couple months and have been working at @huggingface for the summer. I must admit that it has been *loads* of fun. Bit the bullet and drove straight into data governance.😬 Optimistic that I can help build some serious foundations for ethical development.
18
23
753
I really love the active discussion abt the role of ethics in AI, spurred by Google Gemini's text-to-image launch & its relative lack of white representation. As one of the most experienced AI ethics people in the world (>4 years! ha), let me help explain what's going on a bit.
30
167
743
200,233
Wait, what? Dropbox just started giving paid customers data to OpenAI? Is this for real?
For those wondering who the Third Party @Dropbox just gave everyone’s data automatically to, it’s Open AI. Considering all the lawsuits Open AI has concerning illicit use of ill-gotten data, privacy breaches and data leaks this arrangement inspires 0 confidence.Bad move Dropbox.
22
175
691
183,924
Interesting. You can draw a direct line between Google attacking me and @timnitGebru for basic research on LLMs, to Google losing $100 Billion today. Prioritizing the feelings of a couple execs over expert advice on technology may not be ideal eh. H/T hci.social/@bkeegan/10983286…
19
91
687
170,805
1 yr ago, I learned my team was being taken from me on Bloomberg. Tmrw, Google will announce the end of @timnitGebru's firing investigation, pledge to take more care in firing top female scientists, then fire me on the spot without severance & blast gossip about me in int'l news.
10
75
673
Replying to @hotgirlhala
Careful that a review doesn't become an interrogation. If you have to talk to anyone, bring a lawyer. I doubt they would subject a non-employee to interrogation, but they do use interrogation tactics internally for this type of problem.
2
8
648
I'm a computer scientist w PhD focusing on language generation, and 7+ years coding on model dev @ MS & G. Yet so many guys just cannot stop themselves from calling me a linguist...It's the most bizarre thing. I do love language! But that shouldn't cancel out my actual expertise.
30
38
645
110,494
1. The cognitive bias of "Outgroup Homogeneity bias" lumps people you see as "other" together, assuming them to be more alike, and their interests and abilities more alike, than the people within your own "in" group. This also manifests as assuming they're all friends. (2/n)
2
62
608
The big advancement that language generating technology (like ChatGPT) needs to make: Citing its sources.
25
104
650
84,745
(whispers) this is what "stochastic parrot" is capturing as well; it's not a controversial opinion, it's literally how LLMs work (/whispers)
"Most concerning is the illusion that LLMs are retrieving information rather than constructing word associations. LLM responses are statistically likely rather than factually accurate. Sometimes these things correspond, but often they do not." E. Salvaggio techpolicy.press/challenging…
8
110
630
45,928
Today dawns a new horrible life-changing loss in a year of horrible life-changing losses. I can't well articulate the pain of losing @timnitGebru as my co-lead. I've been able to excel because of her--like so many others. I'm mostly in shock. What should I be doing right now?
17
36
654
I no longer believe you can "benefit humanity" by building AGI. Indeed, the exact opposite: Building AGI is placing us on a direct trajectory of harming humanity overall.
73
91
634
58,903
Just read the draft Generative AI guidelines that China dropped last week. If anything like this ends up becoming law, the US argument that we should tiptoe around regulation 'cos China will beat us will officially become hogwash. Here are some things that stood out. 🧵
Who's all checked out the "generative AI" draft guidelines from China? Any good takes? Going through it today. 🤓 cac.gov.cn/2023-04/11/c_1682…
25
162
662
528,206
Okay. Inspired by news & @stealcase, let me clarify something. When AI companies release "open training data" for a model, they're generally sharing *fine-tuning* data. The big issues w data and consent are NOT of this type. The issues are with the MAIN DATA used in training.🧵
8
180
612
150,263
5. "Gender Discrimination" itself includes treating men and women differently, all else held the same. This can include putting up barriers for women to hire other women they are friends with, while not putting up barriers for men to hire other men they are friends with.
3
44
558
It's so weird to me that it's the AI Ethics crowd getting constantly bashed for "fear mongering" because we describe systemic racism, while AI Safety people are literally saying we're all gonna die from AI...
27
96
566
85,115
Really good article pointing out the gender bias in making decisions&shaping understanding about AI. One point it misses that I've observed: When men speak up abt AI&society, they gain tech opportunities. When non-men speak up, they **lose** them. theguardian.com/global-devel…
21
184
592
70,477
No, they won't. Not for current definition of "LLM". This fellow has less experience than me in the area, yet his words will be taken more seriously. Hedged with no 'i believe', no 'i predict', his ill-informed opinions catapult him to wild success where women are crushed.
LLM hallucinations will be largely eliminated by 2025. that’s a huge deal. the implications are far more profound than the threat of the models getting things a bit wrong today.
25
70
569
140,641
Yaaay, my first course was just announced at UW. Thank you @emilymbender for encouraging and supporting me! Covers the construction, analysis, and management of data used to train and evaluate ML models, with a focus on the values that may be encoded throughout data development.
25
35
577
Replying to @alexalbert__
That's fairly terrifying, no? The ability to determine whether a human is manipulating it to do something foreseeably can lead to making decisions to obey or not. Very cool example, thanks for sharing.
24
17
617
102,838
continues to tweet consistent & even anticipatory info about the internals of WH with Trump. Regardless: Helping #resist.
7
99
516
I'm struggling to care about AI. I feel alienated and depressed. I'm watching the priorities I've defined & developed solutions for ignored, while what I've warned & been most concerned about--and offered solutions for--play out in real time. Leaders have been hostile, demeaning.
51
56
559
82,354
Anyway, hi @X, I'm back. Was in Bsky but its moderation is (currently) so poorly managed that a mass amt of people I respect have me blocked as an "AI bro" & there's nothing I can do about it & they will never know. Talking to a void is nice, but talking to people? Also nice.
67
16
658
213,251
Answer: I suspect they literally don't understand how it works. What I wrote above is likely news to them. And they're incentivised not to understand (close your eyes to that Datasheet!!).
9
44
533
45,652
Doing ethics reviews for a few conferences, and boy we've come a long way!! So happy AI is moving down this path. A few years ago, I was thrashed online for "virtue signaling" as I wrote the first Ethical Considerations sections in my papers; now even the thrashers write them.
16
48
570
I am bursting with excitement to finally share an idea that has been cooking for awhile: Measuring Data arxiv.org/abs/2212.05129 When you "measure data", you quantify its characteristics to support dataset comparison & curation. You also begin to know what systems will learn.
17
112
615
✨🎁🎁Super excited to announce the Data Measurements Tool! An open-source project (coded up personally by me, @YJernite, and @SashaMTL) for building, measuring, and comparing datasets -- no programming required!🎁🎁✨ huggingface.co/blog/data-mea…
10
153
583
So amazing to be included in this!! But also remember that there are so many people just as talented, who have worked just as hard or harder, but who didn't have the connections or a public enough voice for inclusion. If that's you, hang in there! time.com/collection/time100-…
21
85
555
67,285
She didn't resign.
I understand the concern over Timnit’s resignation from Google. She’s done a great deal to move the field forward with her research. I wanted to share the email I sent to Google Research and some thoughts on our research process. docs.google.com/document/d/1…
4
55
550
I had a lot of fun being an advisor for John Oliver's crew on this segment! I haven’t watched it yet though, I was cringing too much at some of the simplifications in the near-final script. 🙈 Is it watchable for domain experts? piped.video/Sqa8Zo2XWc4
41
62
549
162,701
Also need to point out how my whiteness so clearly gives me privilege. @timnitGebru & I work on similar topics, have overlapping expertise, nearly identical asks of leadership, even co-led the same group. One of us is fired with misinfo and one of us now manages a massive team.
8
58
527
Personal Gmail is used in training Bard? Cool cool, we don't have robust ways to anonymize data and private data is known to leak from these models, but whatevs amirite.
25
108
510
131,690
Going through my Google exit & NDA information & can't stop the pain in my heart, nausea in my stomach, burning threat of tears in my eyes. More than ever, I am overwhelmed by the Herculean strength required to take legal action and have to LIVE in this world...(1/2)
11
41
488
Hi, I'm over 35 now and I would 100% leave if I didn't need the money. Working in tech as a woman, for most women, fucking sucks.
23
41
495
150,717
3. Given that at the mid-career level there are relatively few technical CS female researchers, the fact that a lot of us know one another is not surprising.
1
30
477
Look guys. If you're worried abt an extinction-level event from AI, one way to *create* that event is to enable LLMs to take actions in the real world. One way to *enable* LLMs to take actions is to give chatbots the ability to incorporate "plugins". openai.com/blog/chatgpt-plug…
36
89
508
139,699
On this date 1 year ago, under Google's employment, my life was about to change. Tomorrow would be the day that Google publicly put out a statement about me that many have understood to be "smearing". There's a lot to say...(1/n)
9
107
487
Following r/bing on Reddit and now Bing is making me cry. 😭
28
58
526
133,399
"LLMs generate responses by randomly sampling [previously seen] words based in part on probabilities" is basically what "stochastic parrot" means btw.
18
96
469
48,714
YAY! The CEO of OpenAI just recognized that LLMs generate text-based tokens using randomness and probability! Something objectively true that people have oddly made controversial! Check out our paper on this that introduced the term. dl.acm.org/doi/10.1145/34421… It's a good day. 🤗🦜
Replying to @willdepue
stochastic parrots can fly so high...
7
76
498
43,601
Maybe it's not Black women who need to be trained. Maybe the people powering the system that says Black women need to be trained could use some training instead. 🙁
Google Announces Initiative To Train 100,000 Black Women In Digital Skills By 2022 trib.al/ZM8xl1H
14
72
475
And yet again. Female is titled as Ms., male is titled as Dr. @nytimes does this over and over. Want to see other examples, and their policy? Let's go! 🧵
Why does the @nytimes address @evijit as Dr. Ghosh but @ruchowdh as Ms. Chowdhury?? On a piece that is partially on AI bias and with two women on the byline @SarahFKessler @TiffKHsu, no less
10
132
482
93,970
6 (!) years ago, @timnitGebru put forward a profound idea for AI research: document your training data. To say she was treated like shit would be putting it lightly. If she had been respected like her male peers were, imagine what a different path AI could have taken.
I'm being asked by journalists what the training data might show, and I'm very happy to explain.
7
100
456
103,411
Maintaining the belief in "magic" properties, and amplifying it to millions (thanks for nothin @60Minutes!) serves Google's PR goals. Unfortunately, it's disinformation. </🧵>
9
48
445
34,361
Did I tell the world I've gone from 'Senior' research scientist to 'Staff'? It sounds like a downgrade, I know. But I'm tech L337 now. Ideal American story of poverty to success, so good job mom teaching me to never let the bastards bring me down.
35
4
515
The data used in machine learning needs to be open for people to interrogate, while also controlled enough not to proliferate. Introducing our framework for Data Governance, which addresses these issues and more! A product of @BigscienceW at FAccT 2022. yjernite.github.io/content/L…
13
105
475
4. Given the fact that many of us are subject to similar discrimination, and also only believed amongst other women who experience the same patterns, some of us do become friends.
2
23
431
Today's my birthday! 🥳 Here are my birthday wishes in light of my Twitter feed. - Ceasefire - Safe AI - Data consent in AI - Fettuccine Alfredo for dinner Followed by: - World peace - Long term beneficial assistive and augmentative AI that neither harms nor exploits people 🙏
68
27
479
36,222
Ack! @kareem_carr , I gotta pipe up. 1. The bias starts before the data 2. Algorithms create, and amplify, race/gender biases, racism, and sexism 3. By "bias" we usu mean discriminated characteristics 4. We have to first improve the culture to fix
FOUR things to know about race and gender bias in algorithms: 1. The bias starts in the data 2. The algorithms don't create the bias but they do transmit it 3. There are a huge number of other biases. Race and gender bias are just the most obvious 4. It's fixable! 🧵👇
10
78
447
Delighted to announce Google's launch of Introduction to Fairness in Machine Learning! A collaboration between many of us, including my team. =) Also features a short video (with me =P) speaking to human biases in the ML cycle, and many other resources. blog.google/technology/ai/ne…
1
198
483
Shaking while I read this. The past 4 years at Google brought trauma and near-constant drama for me. Still, @timnitGebru and I cranked out papers and made a new org. Still, that wasn't good enough to avoid being thrown out and internationally disparaged. bloomberg.com/news/articles/…
6
101
428
New piece out! We explain why Fully Autonomous Agents Should Not be Developed, breaking “AI Agent” down into its components & examining through ethical values. huggingface.co/papers/2502.0… With @evijit @SashaMTL and @GiadaPistilli (1/2)
26
137
503
77,059
OpenAI's Sora is out! Creating video from text. Similar models from other tech companies will likely follow. There are COOL technical things and NOT COOL social things to know about. A super quick 🧵. 1/
13
119
451
150,176
From the Stochastic Parrots paper, on use of the word "tantrum" to describe women's speech. 😕
I hope @timnitGebru does not block me. Since she started attacking me, 24 hours ago, 600 new followers have joined this platform. A coincidence? or perhaps people like seeing non-violent resistance to tantrum?
19
66
426
77,929
Employer is broadcasting that @timnitGebru put forward a binary approach that she would "resign" if they didn't meet her demands. She did not. I realized I was on the email; I DIDN'T EVEN KNOW that was what they were talking about because she didn't even mention resignation.
12
61
432
I somehow finally am working at a company where I can: - Put forth ideas I love - Have those ideas valued - Wake up one day to find they've been implemented (!!!) @huggingface continues to foster cultures of inclusion.
14
17
450
Congratulations to my former co-lead @timnitGebru on launching the DAIR institute today. =) Imagine! An AI center focusing on community, not exploitation; on real change, not meaningless PR. So excited to see this come together. dair-institute.org/
2
37
414
Reminder on who Mustafa is. I wish I could be awful, alienate all the people who aren't my gender around me, and keep getting opportunities. ☹️ For me, and many technical woman, life punches you in the face with your worthlessness again and again and again and again...
Is this what the future looks like? Where are the women in these important discussions?
6
89
401
118,235