REPORTTOTHEPRESIDENT

SuperchargingResearch:

HarnessingArtificialIntelligence

toMeetGlobalChallenges

ExecutiveOfficeofthePresident

President’sCouncilofAdvisorson

ScienceandTechnology

APRIL2024

1

AboutthePresident’sCouncilofAdvisorsonScienceand

Technology

ThePresident’sCouncilofAdvisorsonScienceandTechnology(PCAST)isafederaladvisorycommitteeappointedbythePresidenttoaugmentthescienceandtechnologyadviceavailabletohimfrominsidetheWhiteHouseandfromthefederalagencies.PCASTcomprisesof28oftheNation’sthoughtleaders,selectedfortheirdistinguishedserviceandaccomplishmentsinacademia,government,andtheprivatesector.PCASTadvisesthePresidentonmattersinvolvingscience,technology,andinnovationpolicy,aswellasonmattersinvolvingscientificandtechnologicalinformationthatisneededtoinformpolicyaffectingtheeconomy,workerempowerment,education,energy,theenvironment,publichealth,nationalandhomelandsecurity,racialequity,andothertopics.

FormoreinformationaboutPCASTsee

/pcast.

2

EXECUTIVEOFFICEOFTHEPRESIDENT

PRESIDENT’SCOUNCILOFADVISORSONSCIENCEANDTECHNOLOGY

WASHINGTON,D.C.20502

PresidentJosephR.Biden,Jr.

TheWhiteHouse

Washington,D.C.

DearMr.President,

YourPresident’sCouncilofAdvisorsonScienceandTechnology(PCAST)isexcitedbytheforward-lookingapproachthatyourAdministrationhastakentoadvancethesafeandeffectiveuseofartificialintelligence(AI).

1

,

2

,

3

Asrequestedinyourlandmark

ExecutiveOrderontheSafe,Secure,and

TrustworthyDevelopmentandUseofArtificialIntelligence,

wearepleasedtoreporthereonthepossibilitiesthatAIcanenablewhenappliedtoresearchtoaddressmajorsocietalandglobalchallenges.

AIwillfundamentallytransformthewaywedoscience.ResearchersinmanyfieldsarealreadyemployingAItoidentifynewsolutionstoawidearrayoflong-standingproblems.Today,scientistsandengineersareusingAItoenvision,predictivelydesign,andcreatenovelmaterialsandtherapeuticdrugs.Inthenearfuture,AIwillenableunprecedentedadvancesinthesocialsciences,boththroughnewmethodsofanalyzingexistingdataandthedevelopmentandanalysisofnewkindsofanonymizedandvalidateddata.SuchadvanceswillallowgovernmenttobetterunderstandhowpoliciesaffecttheAmericanpeople,andimprovethosepoliciestobettermeetsocietalneedsandchallenges.AIwillalsoallowresearcherstorunmillionsofcomputer-basedsimulatedexperimentsquicklytoprovideguidanceaboutthemostimportantreal-worldexperimentstorun.Inindustriallaboratories,richsimulationswillbeabletoidentifyhazardsorfaultsindesignsothatscientistsandengineerscancreatesafer,scalable,andefficientproductsthatAmericanindustryandAmericanconsumerscandependon.Insum,AIisrevolutionizingtheresearchprocess,enrichingscientificmodels,andacceleratingdatagenerationandanalysis,withimpactsthatwillbefar-ranging.

Inadditiontoitsopportunities,wemustrecognizethatAIcancreatenewissuesandchallenges,suchasdistillingerrorsandbiasesembeddedinskewedtrainingdata,theenormous—andincreasing—amountsofenergyrequiredforthecomputationalprocesses,thepossibilitythatfaultysciencecouldbeunwittinglygenerated,andtheeasewithwhichnefariousactorscouldusenewpowerfulAItechnologiesformaliciouspurposes.Experthumansupervision,buildingprotectionsintotheAIalgorithms,andacultureofresponsibleusethatincludesappropriateapplicationofregulatoryframeworks,asoutlinedinyour

BlueprintforanAIBillofRights

andthe

AIRiskManagement

Framework

fromtheNationalInstituteofStandardsandTechnology,willbeessentialtomitigatingtheweaknessesanddangersofAI.Fortunately,reproducibilityandvalidationarecoretenetsofthe

1TheWhiteHouse.(2022October).

BlueprintforanAIBillofRights:MakingAutomatedSystemsWorkfor

TheAmericanPeople.

2ExecutiveOrder14110,88FR75191.(2023October).

"Safe,Secure,andTrustworthyDevelopmentandUse

ofArtificialIntelligence."

3TheWhiteHouseOfficeofManagementandBudget.(2024March).

AdvancingGovernance,Innovation,and

RiskManagementforAgencyUseofArtificialIntelligence.

[MemoM-24-10]

3

scientificmethod.Assuch,thescientificcommunityisalreadyengagedinvibrantandpathbreakingresearchonAIreproducibility,testing,andevaluationsothatresearchers—andeveryone—willeventuallybeabletouseAItoolswiththesameconfidencewithwhichweusecalculators.

Ultimately,ourvisionisthattheresponsibleuseofAIwillempowerscientistsandengineerstoleveragetheopportunitiesofthistransformativetechnologywhilenavigatingandmitigatingitsweaknesses.

PeryourExecutiveOrder,andbuildingontheboldworkofyourAdministration,PCASToffersfindingsandrecommendationsforactionthatwillhelptheUnitedStatestoharnessthefullpotentialofAItoequitablyandresponsiblysuperchargeresearchtomeettheworld’schallenges.

Sincerely,

ThePresident’sCouncilofAdvisorsonScienceandTechnology

4

TableofContents

Letterto

TheWhiteHouse 2

WorkingGrouponArtificialIntelligence 9

ExecutiveSummary 10

1.Introduction 15

Anaccelerationofscience 16

Artificialintelligenceandmachinelearning 17

GenerativeAI 18

2.AVisionfortheFutureofAI-EnabledR&D 20

AImethodswillhelpresearchersprioritizethemostlikelysolutions 21

Byhandlingroutinetasks,AIwillallowscientiststofocusoncoreresearch 21

Rotelaboratoryprocesseswillbeautomatedandimproved 22

Previouslyintractablesimulationswillbecomepossible 22

Sharedmodelsanddatawillreduceduplicationofeffort,democratizeresearch,and

reducethetotalcostofusingAI 23

Multimodalfoundationmodelswillbringtogethermultipleformsofdataandcreate

newsynergiesamongbranchesofscience 24

AIwillhelpresearchersdomorewithdata 25

Newformsofcollaborationwillemerge 26

ResponsibleAIpracticeswillbeintegratedintoresearchworkflows 26

OncethenecessaryAIinfrastructureisinplace,newscientific"moonshots"will

becomepossible 27

3.KeyOpportunitiesforAItoSuperchargeDiscoveryandAddressGlobalandSocietal

Challenges 28

3.1.APhaseChangeforMaterialsDiscovery 28

3.2AIforDesigningAdvancedSemiconductors 31

3.3.UnderstandingandAddressingClimateChangeandExtremeWeather 33

3.4RevealingtheFundamentalPhysicsoftheUniverse 35

3.5StudyingHumanBehavior,Organizations,andInstitutions 37

3.6AdvancingFundamentalUnderstandingsintheLifeSciences 39

3.7BreakthroughApplicationsofAIintheLifeSciences 41

4.Findings&Recommendations 46

Finding1:Importantresearchisbeinghinderedbylackofaccesstoadvanced

models 47

5

Recommendation1:ExpandexistingeffortstobroadlyandequitablysharebasicAI

resources 48

Finding2:Cutting-edgeresearchrequiresaccesstohighqualitydata 50

Recommendation2:Expandsecureaccesstofederaldatasetsforapprovedcritical

researchneeds,withappropriateprotectionsandsafeguards 51

Finding3:AIprovidesauniqueresourceforcollaborationsacrossacademia,

industry,andallbranchesofthefederalgovernment 52

Recommendation3:SupportbothbasicandappliedresearchinAIthatinvolves

collaborationsacrossacademia,industry,nationalandfederallaboratories,and

federalagenciesasoutlinedinthevisionfortheNAIRRdevelopedbytheNAIRR

TaskForce 53

Finding4:Withoutproperbenchmarkmetrics,validationprocedures,and

responsiblepractices,AIsystemscangiveunreliableoutputswhosequalityis

difficulttoevaluate,andwhichcouldbeharmfulforascientificfieldandits

applications 54

Recommendation4:Adoptprinciplesofresponsible,transparent,andtrustworthy

AIusethroughoutallstagesofthescientificresearchprocess 54

Finding5:OptimalperformancerequiresbothAIandhumanexpertise 55

Recommendation5:EncourageinnovativeapproachestointegratingAIassistance

intoscientificworkflows 56

5.Conclusion 57

AppendixA:Glossary 58

AppendixB:ExternalExpertsConsulted 61

Acknowledgments 62

6

ThePresident’sCouncilofAdvisorson

ScienceandTechnology

Co-Chairs

FrancesH.Arnold

LinusPaulingProfessorofChemical

Engineering,Bioengineering,and

Biochemistry

CaliforniaInstituteofTechnology

MariaT.Zuber

VicePresidentforResearchandE.A.GriswoldProfessorofGeophysics

MassachusettsInstituteofTechnology

Members

DanE.Arvizu

FormerChancellor

NewMexicoStateUniversitySystem

DennisAssanis

President

UniversityofDelaware

JohnBanovetz

ExecutiveVicePresident,Chief

TechnologyOfficerand

EnvironmentalResponsibility

3MCompany

FrancesColón

SeniorDirector,InternationalClimate

CenterforAmericanProgress

LisaA.Cooper

BloombergDistinguishedProfessorofEquityinHealthandHealthcareandDirectorof

theCenterforHealthEquity

JohnsHopkinsUniversity

JohnO.Dabiri

CentennialProfessorofAeronauticsand

MechanicalEngineering

CaliforniaInstituteofTechnology

AratiPrabhakar

Director,OfficeofScienceandTechnologyPolicy

AssistanttothePresidentforScienceandTechnology

TheWhiteHouse

WilliamDally

ChiefScientistandSeniorVicePresidentfor

Research

NVIDIA

SueDesmond-Hellmann

FormerCEO

Bill&MelindaGatesFoundation

InezFung

ProfessorofAtmosphericScience

UniversityofCalifornia,Berkeley

AndreaGoldsmith

DeanoftheSchoolofEngineeringand

AppliedScienceandtheArthurLeGrandDotyProfessorofElectricalandComputer

Engineering

PrincetonUniversity

LauraH.Greene

ChiefScientist,NationalHighMagneticFieldLaboratory

FloridaStateUniversity,UniversityofFlorida,LosAlamosNational

Laboratory

MarieKrafftProfessorofPhysics

FloridaStateUniversity

7

PaulaHammond

InstituteProfessor,ViceProvostforFaculty,andmemberoftheKochInstitutefor

IntegrativeCancerResearch

MassachusettsInstituteofTechnology

EricHorvitz

ChiefScientificOfficer

Microsoft

JoeKiani

ChairmanandCEO

Masimo

JonLevin

PhilipH.KnightProfessorandDeanofthe

GraduateSchoolofBusiness

StanfordUniversity

StevePacala

FrederickD.PetrieProfessorEmeritusintheDepartmentofEcologyand

EvolutionaryBiology

PrincetonUniversity

SaulPerlmutter

FranklinW.andKarenWeberDabby

ProfessorofPhysicsandDirectorof

theBerkeleyInstituteforData

Science

UniversityofCalifornia,Berkeley

SeniorScientist

LawrenceBerkeleyNationalLabs

WilliamPress

LeslieSurginerProfessorofComputer

ScienceandIntegrativeBiology

TheUniversityofTexasatAustin

JenniferRicheson

PhilipR.AllenProfessorofPsychologyandDirectoroftheSocialPerceptionand

CommunicationLab

YaleUniversity

VickiSato

ProfessorofManagementPractice(Retired)HarvardBusinessSchool

LisaSu

PresidentandCEO

AdvancedMicroDevices(AMD)

KathrynD.Sullivan

FormerAstronaut

NationalAeronauticsandSpace

Administration

FormerAdministrator

NationalOceanicandAtmospheric

Administration

TerenceTao

Professor&theJamesandCarolCollinsChair

intheCollegeofLettersandSciencesUniversityofCalifornia,LosAngeles

PhilVenables

ChiefInformationSecurityOfficer

GoogleCloud

CatherineWoteki

VisitingDistinguishedInstituteProfessorintheBiocomplexityInstitute

UniversityofVirginia

ProfessorofFoodScienceandHumanNutrition

IowaStateUniversity

8

PCASTStaff

LaraCampbell

ExecutiveDirector

RebaBandyopadhyay

DeputyExecutiveDirector

MelissaEdwards

AssistantDeputyExecutiveDirector

Bich-Thuy(Twee)Sim

AssistantDirectorforTransformative

MedicineandHealthInnovation

KimberlyLawrence

AdministrativeSpecialist

RiyaDhar

Intern

MayaMillette

FormerIntern

9

WorkingGrouponArtificialIntelligence

WorkingGroupmembersparticipatedinthepreparationofthisreport.ThefullmembershipofPCASTreviewedandapprovedthereport.

Co-Leads

TerenceTao

Professor&theJamesandCarolCollinsChairintheCollegeofLettersandSciences

UniversityofCalifornia,LosAngeles

Members

JohnBanovetz

ExecutiveVicePresident,Chief

TechnologyOfficerand

EnvironmentalResponsibility

3MCompany

WilliamDally

ChiefScientistandSeniorVicePresidentforResearch

NVIDIA

EricHorvitz

ChiefScientificOfficer

Microsoft

JonLevin

PhilipH.KnightProfessorandDeanoftheGraduateSchoolofBusiness

StanfordUniversity

LauraH.Greene

ChiefScientist,NationalHighMagneticFieldLaboratory

FloridaStateUniversity,Universityof

Florida,LosAlamosNational

Laboratory

MarieKrafftProfessorofPhysics

FloridaStateUniversity

SaulPerlmutter

FranklinW.andKarenWeberDabby

ProfessorofPhysicsandDirectorof

theBerkeleyInstituteforData

Science

UniversityofCalifornia,Berkeley

SeniorScientist

LawrenceBerkeleyNationalLabs

WilliamPress

LeslieSurginerProfessorofComputer

ScienceandIntegrativeBiology

TheUniversityofTexasatAustin

LisaSu

PresidentandCEO

AdvancedMicroDevices(AMD)

PhilVenables

ChiefInformationSecurityOfficer

GoogleCloud

10

ExecutiveSummary

ArtificialIntelligence(AI)hasthepotentialtorevolutionizeourabilitytoaddresshumanity’smosturgentchallengesbyprovidingresearcherswithtoolsthatwillacceleratescientificdiscoveriesandtechnologicaladvances.GenerativeAI,whichcancreatecontentbasedonvastdatasetsandextensivecomputation,ispoisedtobeparticularlytransformative.ExamplesofgenerativeAIincludelargelanguagemodels,imagegeneratingmodels,andgenerativescientificmodels.Inhiscomprehensive

ExecutiveOrderontheSafe,Secure,andTrustworthyDevelopmentandUseofArtificialIntelligence,

issuedonOctober30,2023,PresidentBidenchargedPCASTtoreporton“thepotentialroleofAI…inresearchaimedattacklingmajorsocietalandglobalchallenges.”PCASTispleasedtoofferthisreportinfulfillmentofthischarge.

Withwell-designed,equitablyshared,andresponsiblyusedinfrastructure,AIwillenablescientiststoaddressurgentchallenges,includingimprovinghumanhealthandenhancingweatherpredictioninatimeofclimatechange.AIcanhelpexplorelong-standingscientificmysteriesthatinspireandstretchhumancreativity,suchasuncoveringtheoriginandevolutionoftheuniverse.AIwillalsohelpresearchersaddresscontinuingnationalneeds,fromacceleratedsemiconductorchipdesigntothediscoveryofnewmaterialstoaddressourenergyneeds.Furthermore,AIisstartingtoremovebarriersthatmakescientificresearchslowandexpensive,forinstancebyprovidingthemeansforrapidlyidentifyingthebestdrugcandidatesfortesting(thusreducingthenumberofexpensivelaboratorytrials),helpingtooptimizeexperimentaldesigns,anduncoveringconnectionsindatamuchmoreefficientlythancanbedonebyhandorusingtraditionaldatasciencemethods.IfbasicAIresources,validateddata,andscientifictoolsandtrainingaremadebroadlyaccessible,AItechnologieshavethepotentialtodemocratizescientificknowledge,

4

bringinginterconnectedtechnicalconceptstomanymorepeopleandenablingdiverseresearcherstobringtheirexpertiseandperspectivestosocietalandglobalchallenges.

Justaswithanyothernewtoolortechnology,realizingthepotentialsofAIwillrequireaddressingitslimitations.Theseissuesincludemisleadingorincorrectresults,perpetuationofbiasorinequity

5

andsamplingerrorsfrompatternsembeddedinthemodel-trainingdata,limitedaccesstohighqualitytrainingdata,thechallengesofprotectingintellectualpropertyandprivacy,thesignificantenergyrequiredtotrainordeployamodelorruntheAIalgorithms,andtheriskthatbadornefariousactorswillusereadilyavailableAItoolsformaliciouspurposes.Manypublicandprivatesectoractivitiesaddressingtheseissuesarealreadyunderway,includinggovernmenteffortstaskedundertheOctober2023ExecutiveOrderonAI.ReproducibilityandvalidationarekeyprinciplesunderlyingscientificintegrityandthescientificmethodandmustcontinuetobeheldathighvalueaswedevelopacultureofresponsibleAIuseandexperthumansupervisionofAIapplications.

AIhasthepotentialtotransformeveryscientificdisciplineandmanyaspectsofthewayweconductscience.ScientistsarealreadyemployingAItocreatenewfunctionalmaterialsthatwepresentlydonotknowhowtodesign;theseincludesuperconductorsandthermoelectricmaterialswhichwouldnotonlyenhanceourenergyefficiencybutalsoreduceourcarbonfootprint.Inasimilarvein,AImodelsarehelpingresearcherscreatenewdesignsformanufacturingprocessesandproducts,and

4

5

Dessimoz,C.andThomas,P.(2024March).

AIandthedemocratizationofknowledge.

ScientificData.Birhane,A.(2022October).

TheunseenBlackfacesofAIalgorithms.

Nature.

11

developnewdrugtherapieswhichinthefuturecouldenableindividualizedtreatmentofspecificcancersandviruses.AImodelsarealsohelpingengineersdesignsemiconductorchips,producingbetterdesignswithlesshumaneffortandtime.Inhealthcare,AItechnologiesarecreatingnewwaystoanalyzeabroadspectrumofmedicaldataforapplicationsliketheearlydiagnosisofdiseases

6

thatcanleadtotimelyinterventionandthedetectionofmedicalerrors.

7

PCASTalsoforeseeswidelyavailableAI-poweredultra-personalizedmedicinetailoredtoaspecificindividualanddiseaseprocessthatwillincludedetailsofmedicalhistory,geneticinformation,andsignals,suchashowhealthyandunhealthycellsarebehaving.

AIisalsotransformingsciencebyimprovingourscientificmodels.Inclimatescience,AImodelsarestartingtoenhanceweatherprediction,aswellasadvancingwhole-earthmodelsforwatermanagement,greenhousegasmonitoring,andpredictingtheimpactsofcatastrophes.ScientistshavealreadyusedAItosuccessfullypredictthestructureofproteins;newfoundationmodelswillunlockmoresecretsofcellularbiologyandpowercomputersimulationsofintracellularinteractionsthatcanbeusedtoexplorenewtherapies.AImodelspromisetohelpusunderstandtheoriginofouruniversebyallowingustotestnumerouscosmologicalhypothesesviarapidsimulations.SuchAI-enabledmodelingmayevenhelpscientistsdiscovernewlawsofphysics.

AIwillenableunprecedentedadvancesinthesocialsciences,complementingqualitativemethodswithnewquantitativetechniquesforanalyzingexistingdata,aswellasthedevelopmentandanalysisofnewertypesofdata,e.g.,stepcountsonsmartphones,anonymizeddatadrawnwithpermissionfromsearchandbrowsing,orimagespostedonsocialmedia.AIcouldsuperchargeresearchusingvastdatasets,suchasthosethathavelongbeencollectedandcuratedbyfederalstatisticalagencies—ideallycomplementedbythoseheldbytheprivatesector—asinputfordesigningeffectivefederalpolicies.ApplicationofAItotheselong-standingandnewersocialsciencedatasetscouldfacilitatemoreeffective,responsive,andfairerdata-drivenpolicymakinganddeliveryofservices.

ThesefewexamplesofAI-assistedresearchillustratethatwiththeresponsibleuseofAItechnology,humanscientistswillbeempoweredtorealizetransformationaldiscoveries.Furthermore,PCASTexpectsthatresponsiblesharingofbasicAIresourceswillhelptodemocratizescienceandtacklemajorsocietalandglobalchallenges.

TheuseofAIforscienceandtechnologyresearchisacceleratingrapidlyacrosstheglobeandthereforedemandsourcommitmenttoU.S.leadershipintheapplicationsofthispowerfulnewtool.BuildingontheworkoftheBidenAdministration,theUnitedStatesmustactboldlyandthoughtfullytomaintainournation’sleadinresearch,intheinnovativeapplicationsofAI,andinestablishingframeworksandnormsforthesafeandresponsibleuseofAI.Inthisreport,PCASToffersfivespecificfindingsandrecommendationsforactionthatwillhelptheU.S.toharnessthefullpotentialofAItoequitablyandresponsiblysuperchargescientificdiscovery.

6Bera,K.etal.(2019August).

Artificialintelligenceindigitalpathology-newtoolsfordiagnosisand

precisiononcology.

NatureReviewsClinicalOncology.

7Nguyen,V.etal.(2023November).

Efficientautomatederrordetectioninmedicaldatausingdeep-learning

andlabel-clustering.

ScientificReports.

12

SummaryofRecommendations

Recommendation1:ExpandexistingeffortstobroadlyandequitablysharefundamentalAIresources.

Extensivesupportforwidelyaccessiblesharedmodels,datasets,benchmarks,andcomputationalresourcesisessentialtoensuringthatacademicresearchers,nationalandfederallaboratories,andsmallercompaniesandnon-profitorganizationscanuseAItocreatebenefitsforthenation.IntheU.S.,themostpromisingeffortinthisdirectionistheNationalArtificialIntelligenceResearchResource(NAIRR),whichiscurrentlyapilotproject.PCASTrecommendsthattheNAIRRpilotbeexpeditiouslyexpandedtothescaleenvisionedbytheNAIRRTaskForce

8

andfullyfunded.Thefull-scaleNAIRR,togetherwithindustrypartnershipsandotherAIinfrastructureeffortsatboththefederalandstatelevels,couldserveasasteppingstonetowardsAIinfrastructureprojectsatthenationalorinternationalleveltofacilitatehigh-impactresearch.

Recommendation2:Expandsecureaccesstofederaldatasetsforapprovedcriticalresearchneeds,withappropriateprotectionsandsafeguards.

Thebenefitsofallowinglimited,secureaccesstofederaldatasetsbyapprovedresearchers,aswellasallowingthereleaseofcarefullyanonymizedversionsofsuchdatasetstocuratedresourcecenterssuchasNAIRR,areimmense.PCASTstronglyencouragesexpansionofexistingpilotprogramsforsecuredataaccessandthedevelopmentofguidelinesforfederaldatabasemanagementthatincorporatecutting-edgeprivacyprotectiontechnologiesastheybecomeavailable.ThereisgreatpotentialtousemodernAItechnologiestoautomateaspectsofthecurationofsuchdatasets.PCASTencouragestheuseofAItoimprovedatacurationasalong-termgoaloffederaldatasharinginitiativessuchas

.

PCASTendorsestheeffortsoffederalagenciestomandateresponsiblesharingofdatasetsarisingfromtheresearchthattheyfundorconduct.

9

Weencouragefurtherenforcementofsuchmandates,toincludesharingofAImodelstrainedondatafromfederallyfundedresearch,inconjunctionwithsufficientresourcestosupporttherequiredactions.

Recommendation3:SupportbothbasicandappliedresearchinAIthatinvolvescollaborationsacrossacademia,industry,nationalandfederallaboratories,andfederalagenciesasoutlinedinthevisionfortheNAIRRdevelopedbytheNAIRRTaskForce.

Theboundariesbetweenfederallyfundedacademicresearchandprivatesectorresearcharehazy.Manyresearchersmoveamongaffiliationswithacademicinstitutions,non-profitorganizations,and/orprivatecompanies,andasignificantshareofallAIresearchanddevelopment(R&D)is

8NationalArtificialIntelligenceResearchResourceTaskForce.(2023January).

Strengtheningand

DemocratizingtheU.S.ArtificialIntelligenceInnovationEcosystem:AnImplementationPlanforaNational

ArtificialIntelligenceResearchResource.

9TheWhiteHouseOfficeofScienceandTechnologyPolicy.(2022August).

EnsuringFree,Immediate,and

EquitableAccesstoFederallyFundedResearch.

13

currentlysupportedbyprivatecompanies.

10

TocapitalizefullyonthepotentialbenefitsofAIforscience,researchthatinvolvesabreadthofpromisingandproductivehypothesesandapproachesmustbesupported.Thismayrequirethatfundingagenciesbroadentheirposturesregardinghowtoworkwithindustryandwhichresearcherscanbesupportedinordertofacilitateinnovativeresearcheffortsandcollaborationsamongdifferentsectors.Examplesofsuchcollaborationcouldincludecreationofhighqualitycuratedpublicscientificdatasetsfrommultiplesourcesorthecreationofmultimodalfoundationmodels.

11

Recommendation4:Adoptprinciplesofresponsible,transparent,andtrustworthyAIusethroughoutallstagesofthescientificresearchprocess.

Managingtherisksofinaccurate,biased,harmful,ornon-replicablefindingsfromscientificusesofAIshouldbeplannedfromtheinitialstagesofaresearchprojectratherthanperformedasanafterthought.PCASTrecommendsthatfederalfundingagenciesconsiderupdatingtheirresponsibleconductofresearchguidelinestorequireplansforresponsibleAIusefromresearchers.TheseplansshouldincluderecommendedbestpracticesfromagencyofficesandcommitteesthataddresspotentialAI-relatedrisksanddescribethesupervisionproceduresforuseofanyautomatedprocess.

12

Tominimizeadditionaladministrativeburdenonresearchersandbuildacultureofresponsibility,afterenumeratingmajorrisks,agenciesshouldprovidemodelprocessesforriskmitigation.

Paralleltothis,agenciessuchastheNationalScienceFoundation(NSF)andtheNationalInstituteofStandardsandTechnology(NIST)shouldcontinuesupportingresearchinthescientificfoundationsofresponsibleandtrustworthyAI.ThisresearchshouldincludethedevelopmentofstandardbenchmarkstomeasureAImodelpropertiessuchasaccuracy,reproducibility,fairness,resilience,andexplainableAI,aswellasAIalgorithmsthatmonitorthemselvesforthesepropertiesandadjustwhenthebenchmarksarenotwithindefinednorms.Anothergoalofsuchresearchshouldbethedevelopmentoftoolstoevaluatebiasesindatasetsandtodistinguishsyntheticdatafromrealworlddata.

Recommendation5:Encourageinnovativeapproac