Designing online learning and decision-making algorithms to optimize digital health interventions

Cambridge, MA
Looking forward to doing a tutorial on Causal Inference, Experimental Design and Reinforcement Learning at #NeuRIPS2020!! For a list of all tutorials, see medium.com/@NeurIPSConf/tuto…
2
43
212
I’m thrilled to receive the 2022 Leo Breiman Senior Award!! Looking forward to presenting at JSM 2023 with junior award winners Jing Lei and Ali Shojaie.
7
5
181
I’m looking for a postdoc to join my lab this fall or winter. Come work on exciting problems on reinforcement learning in digital health!! To apply, see academicpositions.harvard.ed….
3
59
121
26,995
I am thrilled to have been selected by the Boston Chapter of the American Statistical Association to receive the 2024 Mosteller Statistician of the Year Award!!
8
3
114
6,175
Congratulations to @raazdwivedi, who is leaving the lab to take up a faculty position at Cornell! We will miss you, Raaz!
4
115
22,691
Postdoc @ShuangningLi will be leaving us in mid-June to start her new job as Assistant Professor of Econometrics and Statistics at University of Chicago Booth School of Business. Congratulations, Shuangning!!
2
2
88
6,678
Postdoc @raazdwivedi has accepted a tenure-track assistant professorship at @Cornell, Operations Research and Information Engineering @Cornell_orie, @Cornell Tech in NYC! Congratulations, Raaz!!!
3
81
46,721
Congratulations to postdoc Tianchen Qian, who just accepted an assistant professorship in the Department of Statistics @UCIrvine! We wish him all the best as he moves on to the next stage of his career in California.
1
73
Congratulations to my colleagues James Robins, @_MiguelHernan, Thomas Richardson, Andrea Rotnitzky, and Eric Tchetgen Tchetgen on winning the 2022 Rousseeuw Prize for Statistics!! So very well-deserved! rousseeuwprize.org/news/winn…
2
56
I’m really excited to be involved in the new Kempner Institute for the Study of Natural and Artificial Intelligence at Harvard University to be directed by my colleagues @ShamKakade6 and @blsabatini!! See news.harvard.edu/gazette/sto…
1
47
It is such an honor to deliver a keynote talk at #NeurIPS2023 tomorrow! For conference info, see nips.cc/
4
51
4,903
Warm congratulations to my colleague Natesh Pillai on his election as a Fellow of the Institute of Mathematical Statistics!
1
4
45
I am thrilled about the new honor the IMS just announced: the Grace Wahba Award and Lecture!!!! Grace, you are my heroine! Donations to support this award can be made here: imstat.org/shop/donation/
4
7
39
It was an honor to deliver a lecture along with fellow Breiman award winners Ali Shojaie and Jing Lei. Chaired by Yufeng Liu!
45
2,307
Delighted to see fellow statisticians Rina Foygel Barber and Lester Mackey among the 2023 #MacFellow class!! See macfound.org/programs/fellow… for the full announcement.
2
6
41
10,036
I’m honored to be a plenary speaker at the 2022 IMS International Conference on Statistics and Data Science (ICSDS2022) in Florence today. For conference information, see sites.google.com/view/icsds2…
1
2
38
#JSM2023 and hockey? Life is perfect!
40
2,403
Congrats to @kewzha on starting her postdoc at Columbia Business School today! We will miss you, Kelly!!
1
40
2,234
I really enjoyed talking to the University of Cambridge undergraduate math society on personalizing mHealth interventions last week! The talk is recorded here: piped.video/watch?v=SkjOrlda…
13
41
Mash Rabbi, who's been a postdoc here for three years, is off to work at Apple in Seattle--we wish him the best in his new position. We will miss him!
35
Today is @qiantianchen’s last day as a postdoc in the Murphy lab. We will miss you, Tianchen, and we wish you all the best in your new life as Assistant Professor of Statistics at UC Irvine!!
2
32
I’m looking for a postdoc to join my lab next year. Come work on exciting problems in sequential decision-making for digital health!! To apply, see academicpositions.harvard.ed….
10
33
5,017
Congratulations to my colleague @XihongLin on receiving the 2021 Mosteller Statistician of the Year award from the ASA’s Boston Chapter for her pioneering work on statistical methods for analyzing massive genomic, epidemiological, and health data!
1
2
34
A nice shot with lab members who came to celebrate the Mosteller award with me last Friday!
1
1
35
2,152
I’m excited to be giving an AAAI 2023 plenary talk at 6pm tomorrow (“We used ReinforcementLearning; but did it work?")! See aaai.org/Conferences/AAAI-23… for the AAAI 2023 schedule.
2
35
4,914
I’m having a great time teaching at the StatML CDT Summer School with @raazdwivedi and @kewzha! For more info on the summer school, see statml.io/index.php/statml-c…
1
33
2,410
Postdoc Hsin-Yu Lai is off to her new research scientist position at the Allen Institute in Seattle. We will miss her!!
2
34
3,655
I’m looking for a postdoc in RL/sequential decision making with applications in digital health! For application instructions, see statistics.fas.harvard.edu/o…
15
34
Coming next October: the first Annual International Day of Women in Statistics and Data Science, organized by the Caucus for Women in Statistics!! Stay tuned for more information… #IDWSDS
2
29
Postdoc Ivana Malenica is teaching the course "Targeted Learning in the tlverse: Techniques and Tools for Causal Machine Learning" at #JSM2023 tomorrow! See ww2.aievolution.com/JSMAnnua… for more info.
2
33
6,074
Congratulations to postdoc Hsin-Yu Lai, who will be leaving us at the end of May to take up a research scientist position at the Allen Institute. We wish her the best as she works on using ML/AI to help people with Alzheimer’s!!
31
1,570
What a honor it was to join @XihongLin at her induction into the U.S. National Academy of Sciences!
32
4,016
Eager to participate in “Frontiers in Causal Inference: Perspectives from Leaders in Tech and Academia” on Friday! If you’d like to join us, register here: cceb.med.upenn.edu/cci/front…
1
10
33
I’m looking forward to my keynote presentation “Inference for longitudinal data after adaptive sampling” tomorrow morning at the ICSA 2022 Applied Statistics Symposium in Gainesville. It’s nice to be able to meet up with colleagues in person again!!
28
I’m looking forward to my virtual talk at Chalmers University tomorrow! I’ll be discussing how to assess whether personalization has occurred after an online RL algorithm has been run in a clinical study. See chalmers.se/en/centres/chair…
1
9
30
I’m looking forward to talking in tomorrow’s #NeurIPS2023 workshop on Goal-Conditioned Reinforcement Learning! For more info on the workshop, see goal-conditioned-rl.github.i…
2
33
2,669
Congratulations to grad student Xiang Meng on getting “Coherent modeling of longitudinal causal effects on binary outcomes” (joint work with Linbo Wang, Thomas Richardson & James Robins) accepted for publication in Biometrics!!
1
28
Xiao-Li Meng (also of the Harvard Statistics Department) hands over the presidency of the Institute of Mathematical Statistics at #JSM2019 in Denver
2
29
We're running our micro-randomized trial brainstorming sessions this week. Here @mk_nock and I are thinking hard @alex_psihogios's presentation on using real-time mhealth approaches to promote oral chemotherapy adherence in adolescents and young adults!
1
3
24
Thrilled to hear that my colleague @XihongLin was just elected to @theNASciences!! Congratulations, Xihong! This honor is so very well deserved!
3
3
31
47,225
Here's a photo from the #ISIWSC2019 Web TV session where I was interviewed as president of the @BernoulliSoc and the @InstMathStat (you can listen at piped.video/watch?v=p0SJg2Mm…)
12
27
Grad student Anna Trella has been busy! On Thursday she was in New York giving the talk “Online Reinforcement Learning Algorithms for Digital Interventions” at the Two Sigma PhD Symposium.
26
1,831
A nice shot of grad student Susobhan Ghosh about to give his talk at the 2023 @INFORMS Healthcare Conference in Toronto!
1
24
2,767
Look out for the new paper by the SARA team: “Translating Strategies for Promoting Engagement in Mobile Health: A Proof-of-Concept Micro-Randomized Trial,” to appear in Health Psychology!
7
27
Looking forward to #JSM2023! I’ll be giving the Leo Breiman award lecture “Personalization via Reinforcement Learning in Digital Health” on 8/8 and enjoying seeing so many colleagues!
2
26
1,837
The Springer book Mobile Health: Sensors, Analytic Methods, and Applications (edited by @RehgJim @SantoshKumarMEM, and me) has received much interest! Check it out at: link.springer.com/book/10.10…!
8
22
Congratulations to the three Murphy lab members who are presenting at ICML 2021 this weekend!!! See following tweets…..
24
The Murphy lab had a great time with Libby Benson (@leb112358) during her visit for her Jump-Start Clinic brainstorming! Clockwise from back left: Yongyi Guo, Ziping Xu, Daiqi Gao, myself, Libby, Susobhan Ghosh, Eura Nofshin, Asim Gazi, @robertjakob, Anna Trella, and @kewzha.
2
25
3,818
I’m looking for a postdoc to join my lab next year. Come work on exciting problems in sequential decision-making for digital health!! To apply, see academicpositions.harvard.ed…
8
21
My colleague @PierreEJacob just won the Guy Medal in Bronze for his innovative and fundamental contributions to Bayesian and computational statistics. Congratulations, Pierre!!
1
22
At the #ISIWSC2019 speaker's wall in Kuala Lumpur! I'll be giving the #IMS Presidental Lecture.
8
23
I am honored to deliver the Samuel S. Wilks Memorial Lecture at Princeton tomorrow afternoon.
2
21
Postdoc @raazdwivedi is touring the country with his talk “From HeartSteps to Heartbeats: Personalized Decision-Making”!! See the following tweets….
6
20
4,843
My heartfelt congratulations to my @UMich colleague Ya’acov Ritov on being awarded the Israel Prize for his seminal contributions to statistics and data science!!
1
23
1,471
Grad student Eura Shin is presenting “Modeling Mobile Health Users as Reinforcement Learning Agents” at the AAAI-2023 workshop AI for Behavior Change on Monday 2/13!!
1
1
20
2,431
I’m so pleased that “Batch Policy Learning in Average Reward Markov Decision Processes” by Peng Liao, Zhengling Qi, Predrag Klasnja, Runzhe Wan, and myself has been accepted for publication by the Annals of Statistics!
1
25
Congratulations to Kyra Gan as she moves on from her postdoc here to an assistant professorship of Operations Research and Information Engineering at Cornell Tech!! We wish you all the best at Cornell, Kyra!
22
2,656
I was honored to participate in this work on just-in-time adaptive interventions for suicide prevention with @ddlcoppersmith, @wathdempsey, Evan Kleiman, @drkatebentley, and @mk_nock: tandfonline.com/toc/upsy20/8…
3
19
Grad students @kewzha, Anna Trella, and @susobhang70 are having a great visit to d3c at UMichigan, working with Pei-Yao Hung and others on designing and implementing stable RL algorithms for MAPS pilot projects!
2
20
1,800
I am honored to be chosen along with Marta Kwiatkowska for a 2021 Van Wijngaarden Award from @CWInl and thrilled to find myself in such good company! See cwi.nl/news/2021/marta-kwiat…
2
3
19
It’s an honor to appear with my colleague Sara van de Geer in the latest issue of the Bernoulli News discussing coffee, careers, and the role of the Bernoulli Society: bernoulli-society.org/public…
1
22
I am enjoying the company of colleagues at KAUST!
23
With other 2019 Guy medalists Jonas Peters and Stephen Buckland and @RoyalStatSoc president Deborah Ashby at @RSSAnnualConf in Belfast
1
3
21
Lunch with new lab members Kyra Gan and Yongyi Guo (2nd and 3rd from left). Welcome, Kyra and Yongyi!!
23
Happiness is talking statistical research with @XihongLin at @mbzuai in Abu Dhabi!
1
23
1,269
Congratulations to my colleague Kosuke Imai on winning a 2024 Guggenheim Fellowship! So well deserved!! See gf.org/announcements/
3
21
2,265
I’m looking forward to talking about assessing personalization in digital health tomorrow at the Brown Biostats Statistics Seminar! See biostatistics.sph.brown.edu/… more information.
4
21
2,877
I had the honor and pleasure to introduce Bin Yu at her Wald II lecture at #JSM2023!
1
22
2,164
Thrilled that my @HarvardStats colleagues @TracyKe7 and Lucas Janson were just promoted to Associate Professors!! Congratulations, Tracy and Lucas—I look forward to many years of collaboration!
21
1,369
I’m looking forward to my virtual talk today at 10:30 am EST, Assessing Personalization in Digital Health, at Oxford’s Department of Statistics! It might still be possible to join--fill in the form here: stats.ox.ac.uk/events/distin…
5
20
I’m looking forward to my keynote “Inference for Longitudinal Data After Adaptive Sampling” tomorrow at NESS 2022. For conference information, see symposium.nestat.org/
2
19
So excited that our micro-randomized feasibility trial of strategies for promoting engagement in mobile health just won the prize for robustness in the University of Michigan MIDAS Reproducibility Challenge! See midas.umich.edu/reproducibil…
1
1
20
Thanks to Miguel Hernan and Mats Stensrud for organizing a wonderful Kolokotrones Symposium last Friday! l-r: Tianchen Qian, Peng Liao, myself, @mk_nock , @mats_julius, @beckyfortgang, and @miguelhernan
1
18
Congrats to postdoc @raazdwivedi on winning an IMS New Researcher Travel Award to attend the 2022 IMS Annual Meeting!!
22
I am delighted to present next Friday at 1pm EST in Harvard’s IACS Distinguished Lecture Series. You can register here for my talk on using RL: iacs.seas.harvard.edu/event/…
1
3
18
Lab members (from left to right) @susobhang70, Asim Gazi, @ShuangningLi, Ziping Xu, and Nowell Closser enjoying a Thai dinner last night. Nowell is modeling the Stat RL lab T-shirts we made!
19
1,707
Grad student @susobhang70 enjoys a nice moment at #SAA2024 with Michigan colleagues Pei-Yao Hung, Jamie Yap, and Shiyu Zhang.
1
19
1,573
I really enjoyed Lauren Bell's brainstorming session on her MRT for the Drink Less app. Thank you, @zongel, for sharing this work with us!
2
19
I’m looking forward to my Monday talk on assessing an RL algorithm’s performance in personalizing intervention delivery at EPFL’s Center for Intelligent Systems! memento.epfl.ch/event/cis-co…
4
18
Delighted that grad student @kewzha will be staying on with us this summer as a postdoc before moving on to a postdoctoral position at Columbia Business School in the Decision, Risk, and Operations Division with Daniel Russo and @hsnamkoong. Congratulations, Kelly!!!
18
1,005
Grad student Xiang Meng just won a Pedagogy Fellowship in Statistics for 2022-2023 from the Derek Bok Center for Teaching and Learning. Congratulations, Xiang!!
18
I’m thrilled to be an Associate Faculty Member at the Kempner Institute!! I’m so excited about this new initiative to understand the basis of intelligence in natural and artificial systems so we can apply AI tech in ways that truly benefit humanity. See harvard.edu/kempner-institut…
1
18
1,916
Another nice photo from the National Academy of Sciences annual meeting, this time with @XihongLin and Iain Johnstone!
16
3,636
I am honored to be giving the fourth Jon A. Wellner Lecture at the University of Idaho’s Department of Mathematics and Statistical Science tomorrow afternoon. See uidaho.edu/sci/mathstat/news…
1
16
Postdoc Ivana Malenica (@podTockom) is giving the spotlight talk "Causality in Goal Conditioned RL: Return to No Future?" in today's #NeurIPS2023 Goal Conditioned RL workshop! For more info, see goal-conditioned-rl.github.i…
2
18
1,951
Congratulations to my sister, Nancy Allbritton, for election to the National Academy of Engineering! nae.edu/312025/NAENewClass20…
16
1,639
Very excited about grad student @kewzha’s invited session “Inference Methods for Adaptively Collected Data” at the IMS 2022 Annual Meeting!! Speakers will be Kelly, @nathankallus, Stefan Wager, and Koulik Khamaru. See imsannualmeeting-london2022.…
2
16
Grad student @susobhang70 visiting former postdocs Kyra Gan and @raazdwivedi at Cornell Tech, where they are enjoying their new jobs as assistant professors!
18
1,118
Two lab members got posters accepted by RLDM2022; congratulations to grad student Anna Trella and undergrad Prasidh Chhabria!! For information on RLDM2022, see rldm.org/
1
15
Harvard’s Office of Undergraduate Education just awarded both @raazdwivedi and Eura Shin a Certificate of Distinction in Teaching for their excellence in TFing the spring 2002 edition of Stat 234. So well deserved!!!
16
So pleased that “Contextual bandits with budgeted information reveal” by Kyra Gan, @EsmaeilKeyvan, Xueqing Liu (@SusieinMay), and myself was accepted to AISTATS 2024!!
2
17
1,948
Postdoc@raazdwivedi is presenting his poster "Counterfactual inference for sequential experimental design" at both the 2022 American Causal Inference Conference and the Synthetic Control Methods Workshop. Way to go, Raaz!
18
Postdoc @ShuangningLi is the discussant at tomorrow’s International Seminar on Selective Inference given by @EugeneKatsevich! See selectiveinferenceseminar.co… to get the zoom invite.
4
17
3,023
With Wenting Cheng at Friday’s Mosteller award ceremony. Many thanks to Wenting for organizing such a lovely evening!!
18
945
Congratulations to @cydeaton on her K23 award!!! I look forward to working with her on an MRT for medication adherence-promoting intervention for teens and young adults with organ transplants.
1
13