Lightnews — Scholar-powered news

Joe Alderman @jaldmn.bsky.social · Mar 18

At a loose end this afternoon? Join @xiaoliu.bsky.social and I online at 1pm for a discussion about algorithmic bias and the STANDING Together recommendations

The STANDING Together recommendations give guidance on how to minimise risk of bias in AI health technologies

Tackling algorithmic bias by promoting transparency in health datasets (The STANDING Together recommendations)

Health data is highly complex and can be challenging to interpret without knowing the context in which it was created. Data biases can be encoded into

aiforgood.itu.int

2

Joe Alderman @jaldmn.bsky.social · Mar 13

Agree. Really important in general, and particularly for healthcare models

www.bmj.com/content/388/...

Uncertainty of risk estimates from clinical prediction models: rationale, challenges, and approaches

www.bmj.com

1

Joe Alderman @jaldmn.bsky.social · Mar 13

This is wild!

Not that he uses it (many people do), but that the department judged FoI to apply here

Chris Stokel-Walker @stokel.bsky.social · Mar 13

🚨 @newscientist.com SCOOP: I've exclusively obtained Peter Kyle's interactions with ChatGPT using FOI laws - in what I believe may be a world-first transparency release. The chatbot said "Lack of Government or Institutional Support" slowed UK AI adoption www.newscientist.com/article/2472...

Revealed: How the UK tech secretary uses ChatGPT for policy advice

New Scientist has used freedom of information laws to obtain the ChatGPT records of Peter Kyle, the UK's technology secretary, in what is believed to be a world-first use of such legislation

www.newscientist.com

1

Reposted by Joe Alderman

Royal Statistical Society @royalstatsoc.bsky.social · Mar 12

We're accepting entries for our 2025 Florence Nightingale Award for Excellence in Health and Care Analytics

Supported by @healthfoundation.bsky.social it celebrates practitioners whose work in data analytics has led to significant improvements in patient care in the UK

Florence Nightingale Award for Excellence in Health and Care Analytics now open

rss.org.uk

2 3

Joe Alderman @jaldmn.bsky.social · Dec 19

Yikes!

Scott McGrath @smcgrath.phd · Dec 19

🧪 A new study by @jdwilko.bsky.social et. al. finds flawed or fake research affects Cochrane reviews, a gold standard in medical reviews, with 25% of trials raising concerns.

A 21-question checklist and automated tools aim to safeguard global medical guidelines. 🩺 🛟

Giant study finds untrustworthy trials pollute gold-standard medical reviews

Two-year collaboration aims to create tools to help counter the tide of flawed research.

www.nature.com

1

Joe Alderman @jaldmn.bsky.social · Dec 18

@altmetric.com 👀

1

Joe Alderman @jaldmn.bsky.social · Dec 18

@unisouthampton.bsky.social @who.int @moorfieldsbrc.bsky.social

Special thanks to our funders & supporters: The NHS AI Lab, The Health Foundation and the NIHR @healthfoundation.bsky.social @nihr.bsky.social

/end.

1

Joe Alderman @jaldmn.bsky.social · Dec 18

@greatormondst.bsky.social @ouhospitals.bsky.social @ox.ac.uk @wellcometrust.bsky.social @newcastleuni.bsky.social @genomicsengland.bsky.social @harvardmed.bsky.social @monashuniversity.bsky.social @swanseauni.bsky.social @natureportfolio.bsky.social @thelancet.bsky.social

14/

1

Joe Alderman @jaldmn.bsky.social · Dec 18

@mdmccradden.bsky.social @stephenpfohl.bsky.social @benglocker.bsky.social @kat-heller.bsky.social @maxi-macki.bsky.social @lorenzorighetto.bsky.social @charlottesummers.bsky.social @unibirmingham.bsky.social @mitofficial.bsky.social @imperialcollegeldn.bsky.social @sheffielduni.bsky.social

13/

1 2

Joe Alderman @jaldmn.bsky.social · Dec 18

Last thing to say is an enormous THANK YOU to all who have contributed their time, energy and expertise to this work.

Thanks for STANDING Together with us these last few years 🥹

(@ing a few people below, but I don't have everyone added on BSky. Sorry if I missed anyone out)

12/

1

Joe Alderman @jaldmn.bsky.social · Dec 18

The recommendations have been published today simultaneously by The Lancet Digital Health and NEJM AI:

ai.nejm.org/doi/full/10....

www.thelancet.com/journals/lan...

11/

Tackling Algorithmic Bias and Promoting Transparency in Health Datasets: The STANDING Together Consensus Recommendations

Without careful dissection of the ways in which biases can be encoded into artificial intelligence (AI) health technologies, there is a risk of perpetuating existing health inequalities at scale. O...

ai.nejm.org

1 1 1

Joe Alderman @jaldmn.bsky.social · Dec 18

We hope STANDING Together helps everyone across the AI development lifecycle to make thoughtful choices about the way they use data, reducing the risk that biases in datasets feed through to biases in algorithms and downstream patient harm.

10/

1

Joe Alderman @jaldmn.bsky.social · Dec 18

These recommendations are the culmination of nearly 3 years of work by an international group of researchers, healthcare professionals, policy experts, funders, medical device regulators, AI/ML developers, and many more besides.

9/

1

Joe Alderman @jaldmn.bsky.social · Dec 18

STANDING Together = STANdards for data Diversity, INclusivity and Generalisability.

We have worked with >350 stakeholders from 58 countries to agree a set of recommendations to improve the documentation and use of health datasets.

8/

1

Joe Alderman @jaldmn.bsky.social · Dec 18

Key point: there is (probably) no such thing as a perfect dataset!

Knowledge of a dataset's limitations is not a negative - it is actually a positive, as steps might then be taken to mitigate any issues. Not knowing ≠ there are no issues...

7/

1

Joe Alderman @jaldmn.bsky.social · Dec 18

Those using datasets should carefully appraise the suitability of the dataset for their purpose, and consider how they might mitigate any biases or limitations contained within.

6/

1

Joe Alderman @jaldmn.bsky.social · Dec 18

To prevent this happening, it's really important that those creating datasets also supply documentation. This should transparently explain what data they contain, and describe any limitations or related issues which those using data should be aware of.

5/

1

Joe Alderman @jaldmn.bsky.social · Dec 18

There are lots of reasons why algorithms can be biased. One key driver is the data used to develop or evaluate them.

Biases in data can pass along the chain and drive biases in algorithms, leading to downstream issues which can be hard to predict in advance.

4/

1

Joe Alderman @jaldmn.bsky.social · Dec 18

BUT: these benefits are not guaranteed. In fact, there is growing evidence that medical AI works better for certain groups than others. This may contribute to health inequity and cause patients harm.

3/

1

Joe Alderman @jaldmn.bsky.social · Dec 18

The world of medical artificial intelligence is moving at a remarkable pace, with a dizzying range of AI/ML tools already available for use in patients' care today.

These tools are undoubtedly cool, and have great potential to improve health!

2/

1 1

Joe Alderman @jaldmn.bsky.social · Dec 18

Hello there BlueSky, it's a great pleasure to be able to share a project our team has been working on these last three years!

(Led by the venerable @xiaoliu.bsky.social)

www.thelancet.com/journals/lan...

1/

Tackling algorithmic bias and promoting transparency in health datasets: the STANDING Together consensus recommendations

Without careful dissection of the ways in which biases can be encoded into artificial intelligence (AI) health technologies, there is a risk of perpetuating existing health inequalities at scale. One major source of bias is the data that underpins such technologies. The STANDING Together recommendations aim to encourage transparency regarding limitations of health datasets and proactive evaluation of their effect across population groups. Draft recommendation items were informed by a systematic review and stakeholder survey.

www.thelancet.com

1 4 15

Reposted by Joe Alderman

The BMJ @bmj.com · Dec 10

The variety and volume of direct-to-consumer medical tests has increased.

This Analysis argues that the public needs high quality information and effective communication about the evidence behind the marketing of these tests
www.bmj.com/content/387/...

10 11

Joe Alderman @jaldmn.bsky.social · Dec 10

At a loose end this afternoon? Come join us at midday for a reflection on 2024 in the world of medical AI 👇

Link to join: turing-uk.zoom.us/j/9214978425...

Joe Alderman @jaldmn.bsky.social · Dec 7

🤝

a man in a suit and a blue shirt is holding a box of lotion .

ALT: a man in a suit and a blue shirt is holding a box of lotion .

media.tenor.com

1