AI Bill of Rights coauthor. Prof@BrownUniversity. Former tech advisor to President Biden @WHOSTP. He/him/his. Tweets my own.
Somewhere between MT and ET
- Tweets 26,538
- Following 917
- Followers 11,938
- Likes 17,440
I'm going to frame this and put it on my office wall.
Artificial Intelligence has enormous potential to tackle some of our toughest challenges.
But we must address its risks.
That's why last year, we proposed an AI Bill of Rights to ensure that important protections for the American people are built into AI systems from the start.
5
4
104
36,455
Teaching my son how to write math in LaTeX. Can't figure out whether I feel like a proud parent or a drug dealer.
26
38
878
It's time for a transition.
1. Moving to @WHOSTP to work with @AlondraNelson46 on bias/fairness.
2. Moving to @BrownUniversity @BrownCSDept @Brown_DSI to work with @senykam on a new center on computing for the people.
14.5 years @UtahSoC - wow!
blog.geomblog.org/2021/05/tr…
113
27
825
This is a crucial point. It's a design choice. Not an accident. And I want to thank @alondra for first articulating this so clearly that it stuck in my brain.
20
162
745
96,157
Wait. Seriously? This is your official position @TheOfficialACM ???
19
127
728
I'm very proud to see the release of the AI Bill of Rights (BoR) today. It all started with a vision articulated by @AlondraNelson46. And is the product of so much hard work and collaboration among so many within @WHOSTP, and within the government.
whitehouse.gov/ostp/news-upd… 1/n
9
183
577
People afraid of AI taking over the world should be required to install a package: preferably something in Julia or tensorflow on a nonstandard architecture.
14
107
596
I was talking to a Ph.D student recently and they asked me (or at least I understood them to be asking) whether, in the light of the Google fiascos and what we're seeing right now with big tech and AI ethics in general whether there's any point in doing the work that I do. 1/n
11
132
538
At a boarding gate: Delta is asking passengers to show their face to a device that they aren't calling a scanner. I ask "I thought face scanning was optional?" They say "it isn't a scanner". I say "but it's scanning my face"? They say "well you can call it that if you insist"
18
77
458
108,634
This is a beautiful interview. And I particularly like this quote, about LLMs.
Of all the AI conversations I’ve been having recently, this was one of the most thought-provoking. For @ftweekend, I had lunch with Ted Chiang, whose stories I encourage you all to read to expand your idea of what is possible.
on.ft.com/3N6VD4W
4
103
426
84,132
My new law is what I'll call "asymptotic Marxism": any discussion about AI and bias will eventually with probability one end in advocating the end of capitalism
14
34
371
Everyone talks about how hard it is to do interdisciplinary work - but no one talks about the HARDEST part: having to write papers in ..... Word.
I feel so unclean...
11
20
370
People getting their @FAccTConference reviews right now, you might want to consider that among other things @timnitGebru is a founder of the conference. When you publish at @FAccTConference you are benefiting from her work.
2
53
318
TFW when multiple papers at a conference build on your not-yet published paper that was rejected from said conference
11
4
335
Consider me welcomed :)
Please welcome Suresh Venkatasubramanian (@geomblog), who joins @BrownCSDept and @Brown_DSI as professor this fall! Read a full interview with Suresh at Brown CS News: bit.ly/2VquLFc
11
3
304
Tired: "The harms you're all documenting are not as important as the sci-fi speculative harms I will now make up."
Wired: "there are no harms at all."
"We shouldn't regulate #AI until we see some meaningful harm that is actually happening [...] There has to be at least a little bit of harm, so that we see what is the real problem" -- Microsoft Chief Economist to #WEF #GrowthSummit23
6
51
213
60,143
The pandemic has been great for job retraining:
Mar-May: epidemiologist
May-July: critical race theorist
July-Sep: child education expert
Oct-Dec: election law expert
Jan: constitutional law expert
Feb: power grid/climate change expert.
6
21
229
I just designed this new tool to punch people in the face. I'm worried that if we release this to the public people will get punched in the face, so we are looking to do a careful and thoughtful release of the punch-people-in-face tool.
#techpolicytoday
10
46
208
29,253
What's going on here is very troubling. I have no doubt that Google will find some plausible sounding pretext. But the fact remains that they are quashing dissent in a topic where dissent is the first order principle, and that shows core unwillingness to think about ethics.
Google targets AI ethics lead Margaret Mitchell after firing Timnit Gebru wp.me/p8wLEc-bb35 by @kharijohnson
5
59
205
Since apparently we are now back to the "algorithms aren't biased, society is" set of arguments, I thought I'd re-up an old post from 2016 that lays out the rules of this particular dance:
algorithmicfairness.wordpres…
4
62
203
For all those grad students driven to a homicidal fury by throwaway reviewer comments trashing their work, who think that one day they'll graduate, get an academic job, get tenured, and promoted, and will achieve a zen like bliss, .....
I HAVE NEWS FOR YOU.
5
2
207
Race is not a scientifically valid concept. It’s a cultural conception that’s made its way into science. slate.com/technology/2019/05… - This seems like a must-read for data scientists.
2
98
188
Pity it didn't go thru an internal review where .... I don't know ..... people might have asked to cite relevant literature
3
10
187
And so it ends. As of fifteen minutes ago, my time at @WHOSTP, working with the amazing Science and Society term, and under the august leadership of @AlondraNelson46, is done. It has been an intense and life-changing journey and I'm honored and grateful for the opportunity. 1/6
9
7
199
People of @FAccTConference, @AIESConf, @ACMEAAMO and other academic venues researching responsible tech: Hope you're all tracking the White House announcement today on safe, secure, and trustworthy AI! Your research has helped get to this point.
whitehouse.gov/briefing-room…
8
36
197
31,833
This probably dates me hopelessly. While I appreciate the excitement and innovation over virtual conferences, I really find it difficult to concentrate at virtual events. There's something about a change of scenery that helps me get into "conference mode".
12
7
187
I thought this was the most foreboding paragraph from the excellent article by @_KarenHao and @cwarzel: theatlantic.com/technology/a…
ALT Read differently, however, whether Altman stays or goes will do little to resolve a dangerous flaw present in the development of artificial intelligence. For the past 24 hours, the tech industry has held its breath, waiting to see the fate of Altman and OpenAI. Though Altman and others pay lip service to regulation and say they welcome the world’s feedback, this tumultuous weekend showed just how few people have a say in the progression of what might be the most consequential technology of our age. AI’s future is being determined by an ideological fight between wealthy techno-optimists, zealous doomers, and multibillion-dollar companies. The fate of OpenAI might hang in the balance, but the company’s conceit—the openness it is named after—showed its limits. The future, it seems, will be decided behind closed doors.
3
60
170
32,914
Big announcement from the White House today on what companies need to do to ensure responsible AI development. whitehouse.gov/briefing-room…
Let's unpack the details. And there will be grades! (this is after all the end of semester). 🧵
4
61
178
82,951
Today is a very important day for AI governance in the US. The @OMBPress released their instructions for all Federal agencies on how to protect our rights when considering the use of AI, following up on Oct 2023 EO on safe, secure, and trustworthy AI. whitehouse.gov/briefing-room… 1/n
3
66
172
48,783
CS people. We need to tattoo this on our screens. Ever since I've started looking at algorithmic fairness all I've been doing is screaming about the epistemic sloppiness of ML. and read the entire thread.
2
47
163
I can't believe I'm having to teach my kids how to use a fountain pen and having to explain that this was the default mode for all writing when I was in school. Moreover, that we waited for the day when we were allowed to use fountain pens.
20
1
140
So if I'm moving into a house where the previous occupants were lax about covid protocols and got repeatedly infected, do I need to fumigate it and how long will that take? My move in date is Jan 20 and the house has 132 rooms and 35 bathrooms.
Asking for a friend.
5
9
138
COVID and India: a thread.
Last April, when numbers first started spiking across the world, my close college friends and I started doing a weekly zoom call to check in and connect up. Most of our initial calls were the usual armchair epidemiology and R_0 rantings 1/n
4
14
137
And we should continue to expect a lot more expert comms FUD. But to get to this point is something. And I think one of the shining points of @_KarenHao's article is how she cleanly exposes the rhetorical games that are being played without overly simplifying. 10/n=10
6
5
124
In CS, we publish and then give talks based on published work. In many other disciplines, the talk is the first attempt to flesh out ideas that eventually end up in a paper. I’m finding myself doing the second more and more.
5
8
140
In a bold/stupid move, I have decided to write a post about each session of @fatconference. Here is the first, on framing and abstraction: algorithmicfairness.wordpres…
6
31
128
How do people manage to keep track of ML papers? This is not a request for support in my current state of bewilderment - I'm genuinely asking what strategies seem to work to read (or "read") what appear to be 100s of papers per day.
20
8
119
39,412
Roko's* five stages of AI grief:
1. Denial: "there is no bias in AI systems. Math is not racist."
I feel like we have largely moved on from this stage, thanks to all the reporting we've had over the years.
* the basilisk will always be with you
3
47
108
41,571
Wait. Seriously. Are you trying to troll here? "history is irrelevant for machine learning" since when? Do you know the history of statistics and its connection to eugenics? And "math is an exact science" - yes if you're not applying math MODELING to the real word.
2
8
110
[Narrator]: it doesn't
DeepSense, a company based in San Francisco and New Delhi, uses artificial intelligence to assess job candidates’ personalities based on their social media accounts. @jasonbellini finds out how it all works. #WSJWhatsNow
1
15
113
CSS is biased against long names. And yes I'm at the Senate tomorrow.
hsgac.senate.gov/hearings/ar…
7
116
18,802
.@TonyHoWasHere from @thedailybeast pushes back on all the Altman smoke and mirrors, with help from @emilymbender and me.
thedailybeast.com/how-congre…
1
44
109
19,240
My son, concerned: "My essay needs to be 1500 characters and it's 1900 characters right now!"
@picturewing and I (both academics): "Stand back, young Padawan".
3
2
119
Some thoughts on centering, solutionism, justice and (un)fairness in the context of research on algorithmic fairness. algorithmicfairness.wordpres…
2
24
121
I'm on the board for @datasociety - one of THE BEST organizations thinking through the implications of our collisions between tech and society. And I wanted to give a shout out the Algorithmic Impact Methods Lab that they've just started (datasociety.net/algorithmic-…). 1/n
1
24
112
16,222
CNN talks to me about LLM "hallucinations". I'm most proud that the shoutout to my kids made it into the article:
cnn.com/2023/08/29/tech/ai-c…
4
12
113
11,984
Minor molehill I am prepared to die on: sensitivity and specificity are utterly stupid terms and anyone who uses them should be tarred and feathered.
11
9
113
I'm really enjoying reading this paper. Anthropomorphism is an EXPLICIT DESIGN CHOICE, not something that just happens by accident. As the example illustrates and as the paper discusses, it's entirely possible to design systems that avoid anthropomorphizing.
Absolutely loving this zinger from @ZeerakTalat and friends about the dangers of anthropomorphizing AI systems -- it does an amazing job at explaining all of the risks that come with it! A must read 🤗
arxiv.org/pdf/2305.09800.pdf
6
27
101
17,871
A simple question then. Why didn't they? Surely in 2020 one can't get away with saying "oops bad data". Not to mention all the other ways that @timnitGebru outlines that biasbcam creep in. I really don't think it's credible to say at this point that "it's just bad data"
ML systems are biased when data is biased.
This face upsampling system makes everyone look white because the network was pretrained on FlickFaceHQ, which mainly contains white people pics.
Train the *exact* same system on a dataset from Senegal, and everyone will look African.
6
19
104
And ...... It's out! And is longer than the AI bill of rights :).
whitehouse.gov/briefing-room…
9
21
107
22,296
The big shift that I am beginning to see now with Karen's article is to "Hey we have amazing researchers doing stuff on AI Bias. What? they're telling us we are bad. FIRE THEM" or "Sorry, anything actually relevant is outside your purview" 8/n
1
10
100
AI bias folks: NIST is requesting comment on a new framework for identifying and managing bias in AI. Deadline is Aug 5. Please do comment!
nist.gov/news-events/news/20…
1
55
104
For all the people who claim that the H1B gets misused to exclude domestic workers, it might be helpful to know that at most US universities, close to 80% of graduate admissions in CS are foreign students. 1/6
3
32
96
I gave a brief answer at the time, to the effect of "the fact that we're seeing pushback means that our efforts are working", which felt a little unsatisfactory to me. But with @_KarenHao's brilliant new article on Facebook I feel like there's a more concrete shift. 2/n
1
6
88
Me in @WIRED today: We don't need more forums and talk talk talk. It's time for the WH to issue an executive order on AI governance.
wired.com/story/the-white-ho…
4
41
95
42,750
One component of transparency in ML oversight is: "what data was the model trained on". It seems like this would be impossible to answer for LLMs, (and might very well be), but the fascinating thread below shows why the answer to this question is important: 1/n
Many viral ChatGPT examples involve testing on the training set. In the quoted tweet it writes a decent review, but it's been trained on ~5,000 papers that cite/discuss this paper. I asked it for a review *without* giving it the text and it hit most of the points in the original.
ALT Who wrote the paper "The Dynamics of Crowdfunding: An Exploratory Study"? The paper "The Dynamics of Crowdfunding: An Exploratory Study" was written by Ethan R. Mollick. This paper was published in 2014 and investigates the factors that affect the success and failure of crowdfunding projects. Arvind Narayanan Summarize the strengths and weaknesses of the paper Strengths: Pioneering research: This paper is one of the first comprehensive studies on the dynamics of crowdfunding, making it an important contribution to the field. Large dataset: The study is based on a large dataset of over 48,000 crowdfunding projects, which adds to the robustness and generalizability of the findings. Multiple factors analyzed: The paper considers a wide range of factors affecting crowdfunding success, including personal networks, geography, project categories, project goals, and more, providing a nuanced understanding of the phenomenon. Statistical rigor: The study employs multiple regression models t
4
18
96
174,672
AI policy discourse is a weird mix of mealy-mouthed blandness (coming for you, NAIAC) and apocalyptic terror. Given that, the @FTC's straight up no-BS DGAF blog posts are a refreshing breeze. Latest exhibit: the "Luring Test" - brilliant!
ftc.gov/business-guidance/bl…
5
33
88
29,914
It's a little depressing and also hopeful that students in my data science ethics class would be able to shoot down this argument in 10 seconds flat.
It's alarming that NeurIPS papers are being rejected based on "ethics reviews". How do we guard against ideological biases in such reviews? Since when are scientific conferences in the business of policing the perceived ethics of technical papers?
7
8
86
"back in the day", when I first was talking to journalists about AI bias, I remember people saying, "well yeah, but this is all hypothetical. give me a real example where something happened and we'll talk". Similarly, most tech companies were like "AI Bias? Who dat?" 3/n
2
6
91
The ProPublica article on COMPAS changed the public discussion in ways it's hard to explain. But at the very least, it shifted the discourse to "AI Bias? Yeah society sucks, but it's not our problem, we're just tech people". Not a big shift, but wait....4/n.
1
5
87
Instead of conducting multiple slack and twitter conversations, I decided to write a post on the new stochastic parrots paper by @emilymbender, @timnitGebru, @mcmillan_majora
and an Aether wielding script writing elemental entity.
algorithmicfairness.wordpres…
7
13
90
Churchill is finally getting a much deserved reckoning, and this article explains why people in India viewed him in the same category as Hitler. 2-3 million people died in the Bengal famine which he made much worse.
atlasobscura.com/articles/in…
1
30
80
This article is a short but brilliant articulation of so many of the issues to consider with algorithmic governance. And without a single LLM in sight! Let's go through it.
Italy has a problem with teachers. An #algorithm was supposed to save time by allocating teachers on short-term contracts to schools automatically. Failures in the code and design severely disrupted teachers’ lives, reports our fellow @PierluigiBizz. ⤵️
algorithmwatch.org/en/algori…
6
35
87
25,579
I'm really puzzled by this. We have @datasociety, @AINowInstitute, @BKCHarvard and so many more, and like many others I'm constantly on the road talking with orgs and groups about this. Not to mention the upcoming @fatconference in NYC. Academics are way on top of this.
8
13
81
This is an illuminating interview. I'm not going to summarize it - just read the whole article.
mathbabe.org/2024/03/16/an-i…
9
26
89
48,978
New article by @carolineha_ on the methodological problems with predpol and predictive policing, with comments from @KLdivergence and me. This is "algorithms are also bad" complement to new @AINowInstitute report "data is bad" for predictive policing. motherboard.vice.com/en_us/a…
5
28
85
This is insane. It places foreign students who are essentially helpless in a middle of huge argument over online vs in-person teaching. No university will be able to go fully online (which is arguably the medically responsible thing to do) if it shafts their students like this.
ICE is telling international students on F-1 and M-1 visas that if their school is doing online-only courses they must leave the country or transfer to a place with in-person instruction—or they'll be deemed in the US illegally and subject to deportation. ice.gov/news/releases/sevp-m…
2
8
81
Happy to note that my official (and verified!) OSTP account is now active at @SureshVenkat46. Please follow that for OSTP related information and representations. You can expect my usual mix of snark, horror and AI+society ruminations to continue here.
7
6
81
Upshot: I asked whether I need to use the not-scanner. They said yes, but you're going to need to have your passport and boarding card ready and open.
I'm clearly not getting the good snacks on this flight.
2
1
77
11,989
"my code should do what I program it to do" and "I tried to break the code and it broke" is how we do security. Not incompatible at all. The difference is that we don't deploy untested code and be surprised when it breaks...
Ht @Abebab and @mmitchell_ai
“AI needs to do whatever i ask” and “i asked the AI to be sexist and it was, look how awful!” are incompatible positions.
somewhat surprised by the number of people who hold both.
2
11
74
13,349
For those who appreciate cricket, understand Hindi, and follow US politics (yes it's a specialized group)
7
5
86
I can't believe we are 7 months into a pandemic and Zoom hasn't yet figured out how to add audio filters like canned applause. Would make keynotes so much better. You could also have "accidental cell phone ringing" or "unmuted youtube video" or...
4
3
80
There's no doubt there's a series of bobs and weaves here to avoid doing what is truly painful. But I can't look at this and not think - whatever the community of people thinking about this issue is doing, it's actually working. There's a long way to go no doubt. 9/n
1
2
74
People I write recommendation letters for: I am excited for your future plans and support them. And I'd love to know where you end up. But I don't want to badger you with questions so if you could drop me a note when your plans are set I'd greatly appreciate it :).
4
79
The weird thing about failure. There's an assumption that "once you get tenure/success/fame/seniority" you will able to shed your insecurities/imposter syndrome/other ways in which your internal description of yourself is different from what you present as #AcademicChatter 1/
2
6
77
Exactly. Timnit's work has not only survived 'peer review', it has survived the test of time and actual citation. I'm writing a paper right now that cites datasheets, model cards and gender shades all in one section. Maybe some of these 'Blind'ers should actually try writing.
3
2
76
"There is no AI exemption to the laws on the books". This is a strong statement from the chairs of federal enforcement agencies. Kudos to @FTC, @USEEOC, @CFPB, and @CivilRights. ftc.gov/news-events/news/pre…
1
35
70
15,183
I just published “Awake on the Autobahn: Academics, algorithms and accountability” medium.com/p/awake-on-the-au…
1
39
76