AI deception : A survey of examples, risks, and potential solutions

Journal article

Park, Peter S., Goldstein, Simon, O'Gara, Aidan, Chen, Michael and Hendrycks, Dan. (2024). AI deception : A survey of examples, risks, and potential solutions. Patterns. 5(5), pp. 1-16. https://doi.org/10.1016/j.patter.2024.100988
AuthorsPark, Peter S., Goldstein, Simon, O'Gara, Aidan, Chen, Michael and Hendrycks, Dan
Abstract

AI systems are already capable of deceiving humans. Deception is the systematic inducement of false beliefs in others to accomplish some outcome other than the truth. Large language models and other AI systems have already learned, from their training, the ability to deceive via techniques such as manipulation, sycophancy, and cheating the safety test. AI’s increasing capabilities at deception pose serious risks, ranging from short-term risks, such as fraud and election tampering, to long-term risks, such as losing control of AI systems. Proactive solutions are needed, such as regulatory frameworks to assess AI deception risks, laws requiring transparency about AI interactions, and further research into detecting and preventing AI deception. Proactively addressing the problem of AI deception is crucial to ensure that AI acts as a beneficial technology that augments rather than destabilizes human knowledge, discourse, and institutions.

Year01 Jan 2024
JournalPatterns
Journal citation5 (5), pp. 1-16
PublisherCell Press
ISSN2666-3899
Digital Object Identifier (DOI)https://doi.org/10.1016/j.patter.2024.100988
Web address (URL)https://www.sciencedirect.com/science/article/pii/S266638992400103X?via%3Dihub
Open accessPublished as ‘gold’ (paid) open access
Research or scholarlyResearch
Page range1-16
Publisher's version
License
File Access Level
Open
Output statusPublished
Publication dates
Online10 May 2024
Publication process dates
Deposited10 Oct 2024
Additional information

© 2024 The Authors. Published by Elsevier Inc.

This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).

Supplementary material available at: https://www.sciencedirect.com/science/article/pii/S266638992400103X?...

Place of publicationUnited States
Permalink -

https://acuresearchbank.acu.edu.au/item/9100x/ai-deception-a-survey-of-examples-risks-and-potential-solutions

Log in to edit

Download files

Publisher's version
OA_Goldstein_2024_AI_deception_A_survey_of_examples.pdf
License: CC BY-NC-ND 4.0
File access level: Open

  • 30
    total views
  • 6
    total downloads
  • 12
    views this month
  • 1
    downloads this month
These values are for the period from 19th October 2020, when this repository was created.

Export as

Related outputs

Shutdown-seeking AI
Goldstein, Simon David and Robinson, Pamela. (2024). Shutdown-seeking AI. Philosophical Studies : an international journal for philosophy in the analytic tradition. pp. 1-13. https://doi.org/10.1007/s11098-024-02099-6
A question-sensitive theory of intention
Beddor, Bob and Goldstein, Simon. (2023). A question-sensitive theory of intention. The Philosophical Quarterly. 73(2), pp. 346-378. https://doi.org/10.1093/pq/pqac031
Getting accurate about knowledge
Carter, Sam and Goldstein, Simon. (2023). Getting accurate about knowledge. Mind. 132(525), pp. 158-191. https://doi.org/10.1093/mind/fzac009
Language agents reduce the risk of existential catastrophe
Goldstein, Simon and Kirk-Giannini, Cameron Domenico. (2023). Language agents reduce the risk of existential catastrophe. AI & Society. pp. 1-11. https://doi.org/10.1007/s00146-023-01748-4
Attitude verbs’ local context
Blumberg, Kyle and Goldstein, Simon. (2023). Attitude verbs’ local context. Linguistics and Philosophy. 46(3), pp. 483-507. https://doi.org/10.1007/s10988-022-09373-y
Fragile knowledge
Goldstein, Simon. (2022). Fragile knowledge. Mind. 131(522), pp. 487-515. https://doi.org/10.1093/mind/fzab040
Contextology
Goldstein, Simon and Kirk-Giannini, Cameron Domenico. (2022). Contextology. Philosophical Studies. 179(11), pp. 3187-3209. https://doi.org/10.1007/s11098-022-01820-7
Sly Pete in dynamic semantics
Goldstein, Simon David. (2022). Sly Pete in dynamic semantics. Journal of Philosophical Logic. 51(5), pp. 1103-1117. https://doi.org/10.1007/s10992-022-09660-w
Knowledge from multiple experiences
Goldstein, Simon and Hawthorne, John. (2022). Knowledge from multiple experiences. Philosophical Studies. 179(4), pp. 1341-1372. https://doi.org/10.1007/s11098-021-01710-4
Counterfactual contamination
Goldstein, Simon and Hawthorne, John. (2022). Counterfactual contamination. Australasian Journal of Philosophy. 100(2), pp. 262-278. https://doi.org/10.1080/00048402.2021.1886129
Probability for epistemic modalities
Goldstein, Simon and Santorio, Paolo. (2021). Probability for epistemic modalities. Philosophers' Imprint. 21(33), pp. 1-37.
Mighty knowledge
Beddor, Bob and Goldstein, Simon. (2021). Mighty knowledge. Journal of Philosophy. 118(5), pp. 229-269. https://doi.org/10.5840/jphil2021118518
The normality of error
Carter, Sam and Goldstein, Simon. (2021). The normality of error. Philosophical Studies. 178, pp. 2509-2533. https://doi.org/10.1007/s11098-020-01560-6
Losing confidence in luminosity
Goldstein, Simon and Waxman, Daniel. (2021). Losing confidence in luminosity. Noûs. 55(4), pp. 962-991. https://doi.org/10.1111/nous.12348
Epistemic modal credence
Goldstein, Simon. (2021). Epistemic modal credence. Philosophers' Imprint. 21(26), pp. 1-24.
The counterfactual direct argument
Goldstein, Simon. (2020). The counterfactual direct argument. Linguistics and Philosophy. 43(2), pp. 193-232. https://doi.org/10.1007/s10988-019-09272-9
Free choice impossibilty results
Goldstein, Simon. (2020). Free choice impossibilty results. Journal of Philosophical Logic. 49(2), pp. 249-282. https://doi.org/10.1007/s10992-019-09517-9
Conditional heresies
Cariani, Fabrizio and Goldstein, Simon. (2020). Conditional heresies. Philosophy and Phenomenological Research. 101(2), pp. 251-282. https://doi.org/10.1111/phpr.12565
A theory of conditional assertion
Goldstein, Simon. (2019). A theory of conditional assertion. Journal of Philosophy. 116(6), pp. 293-318. https://doi.org/10.5840/jphil2019116620
Generalized update semantics
Goldstein, Simon. (2019). Generalized update semantics. Mind: A Quarterly review of philosophy. 128(511), pp. 795-835. https://doi.org/10.1093/mind/fzy076
Free choice and homogeneity
Goldstein, Simon. (2019). Free choice and homogeneity. Semantics and Pragmatics. 12, pp. 1-47. https://doi.org/10.3765/sp.12.23
Triviality results for probabilistic modals
Goldstein, Simon. (2019). Triviality results for probabilistic modals. Philosophy and Phenomenological Research. 99(1), pp. 188-222. https://doi.org/10.1111/phpr.12477
A stronger doctrine of double effect
Bronner, Ben and Goldstein, Simon. (2018). A stronger doctrine of double effect. Australasian Journal of Philosophy. 96(4), pp. 793 - 805. https://doi.org/10.1080/00048402.2017.1400572
Believing epistemic contradictions
Beddor, Bob and Goldstein, Simon. (2018). Believing epistemic contradictions. The Review of Symbolic Logic. 11(1), pp. 87-114. https://doi.org/10.1017/S1755020316000514
A preface paradox for intention
Goldstein, Simon. (2016). A preface paradox for intention. Philosophers' Imprint. 16(14), pp. 1-20.