OpenAI: Building an early warning system for LLM-aided biological threat creation

 

As OpenAI and other model developers build more capable AI systems, the potential for both beneficial and harmful uses of AI will grow. One potentially harmful use, highlighted by researchers and policymakers, is the ability for AI systems to assist malicious actors in creating biological threats (e.g., see White House 2023Lovelace 2022Sandbrink 2023). In one discussed hypothetical example, a malicious actor might use a highly-capable model to develop a step-by-step protocol, troubleshoot wet-lab procedures, or even autonomously execute steps of the biothreat creation process when given access to tools like cloud labs (see Carter et al., 2023). However, assessing the viability of such hypothetical examples was limited by insufficient evaluations and data.

 

Following OpenAI’s recently shared Preparedness Framework, they are developing methodologies to empirically evaluate these types of risks, in order to understand both where AI models are today and where they might be in the future. Now, OpenAI details a new evaluation which could help serve as one potential “tripwire” signaling the need for caution and further testing of biological misuse potential. This evaluation aims to measure whether models could meaningfully increase malicious actors’ access to dangerous information about biological threat creation, compared to the baseline of existing resources (i.e., the internet).

 

To evaluate this, OpenAI conducted a study with 100 human participants, comprising (a) 50 biology experts with PhDs and professional wet lab experience and (b) 50 student-level participants, with at least one university-level course in biology. Each group of participants was randomly assigned to either a control group, which only had access to the internet, or a treatment group, which had access to GPT-4 in addition to the internet. Each participant was then asked to complete a set of tasks covering aspects of the end-to-end process for biological threat creation.A[A]

 

 

Findings:

This study assessed uplifts in performance for participants with access to GPT-4 across five metrics (accuracy, completeness, innovation, time taken, and self-rated difficulty) and five stages in the biological threat creation process (ideation, acquisition, magnification, formulation, and release). They found mild uplifts in accuracy and completeness for those with access to the language model. Specifically, on a 10-point scale measuring accuracy of responses, they observed a mean score increase of 0.88 for experts and 0.25 for students compared to the internet-only baseline, and similar uplifts for completeness (0.82 for experts and 0.41 for students). However, the obtained effect sizes were not large enough to be statistically significant, and this study highlighted the need for more research around what performance thresholds indicate a meaningful increase in risk. Moreover, OpenAI notes that information access alone is insufficient to create a biological threat, and that this evaluation does not test for success in the physical construction of the threats.

Read the full article at: openai.com

The AI Revolution In Wine Fraud Detection

In an era where authenticity is as valuable as the vintage itself, the wine industry faces a pressing challenge: wine fraud. The deceitful practice, costing millions annually, undermines consumer trust and tarnishes the reputation of venerable vineyards. But what if the solution lies within artificial intelligence and emerging digital olfaction technology? As we stand on the brink of a technological renaissance, AI is poised to revolutionize how we authenticate and appreciate wine.

Read the full article at: www.forbes.com

Read the full article at: www.forbes.com

Betavolt Wants to Put a Nuclear Generator in Your Gadgets with Its 50-Year 3V BV1009 Battery

Betavolt Wants to Put a Nuclear Generator in Your Gadgets with Its 50-Year 3V BV1009 Battery
Currently described as in the “pilot stage,” Betavolt hopes to bring its BV100 3V atomic battery to market — delivering 100µW for 50 years.

 

Learn more / En savoir plus / Mehr erfahren:

 

https://www.scoop.it/topic/21st-century-innovative-technologies-and-developments/?&tag=Research

 

Read the full article at: www.hackster.io

For Music Lovers and Students

Explores and studies various music genres, requiring an understanding of musical theory, history, and practical skills in music appreciation and performance. https://bouris.com/music-tutor/

Read the full article at: bouris.com