AI Jesus Needs RAG Safeguards
Key Points
- A Swiss church created an “AI Jesus” using a HAEN avatar with ChatGPT‑4 for text and Whisper for voice, and a post‑experience survey showed roughly two‑thirds of participants found it meaningful and spiritually engaging.
- The speaker argues the system was built incorrectly, drawing a parallel to Air Canada’s AI mishap where lack of safeguards caused hallucinated, legally damaging responses.
- To serve as a credible spiritual authority, the AI should have been built on a retrieval‑augmented generation (RAG) architecture that pulls directly from authoritative religious texts (e.g., the Bible) rather than relying solely on a generic language model.
- Incorporating guardrails and source‑specific retrieval would prevent the AI from unintentionally mixing in unrelated Buddhist, Hindu, or other spiritual content that the church did not intend to convey.
- Although the project was a localized experiment, the speaker emphasizes that using the proper AI toolchain and safeguards is essential when creating any AI‑based figure of spiritual authority.
Full Transcript
# AI Jesus Needs RAG Safeguards **Source:** [https://www.youtube.com/watch?v=jLsRpuXqDP0](https://www.youtube.com/watch?v=jLsRpuXqDP0) **Duration:** 00:02:31 ## Summary - A Swiss church created an “AI Jesus” using a HAEN avatar with ChatGPT‑4 for text and Whisper for voice, and a post‑experience survey showed roughly two‑thirds of participants found it meaningful and spiritually engaging. - The speaker argues the system was built incorrectly, drawing a parallel to Air Canada’s AI mishap where lack of safeguards caused hallucinated, legally damaging responses. - To serve as a credible spiritual authority, the AI should have been built on a retrieval‑augmented generation (RAG) architecture that pulls directly from authoritative religious texts (e.g., the Bible) rather than relying solely on a generic language model. - Incorporating guardrails and source‑specific retrieval would prevent the AI from unintentionally mixing in unrelated Buddhist, Hindu, or other spiritual content that the church did not intend to convey. - Although the project was a localized experiment, the speaker emphasizes that using the proper AI toolchain and safeguards is essential when creating any AI‑based figure of spiritual authority. ## Sections - [00:00:00](https://www.youtube.com/watch?v=jLsRpuXqDP0&t=0s) **Swiss AI Jesus Misstep** - A Swiss church built an AI Jesus using a chatbot avatar and received positive user feedback, but the speaker contends the system is fundamentally flawed due to a lack of safeguards and argues it should employ a retrieval‑augmented generation model to remain faithful to its religious foundations. ## Full Transcript
a Swiss church built AI Jesus and I
think they built it incorrectly we're
going to talk about it so we're familiar
with the idea of AI as companions that's
one of the hottest themes in 2024 some
of the fastest growing consumer startups
in AI are around the idea of
companionship spirituality is a new one
uh and this church used a haen avatar
they hooked it up to cat GPT
40 and they had whisper as the voice
mode that's fine as far as it goes
certainly the people who used it enjoyed
it uh 2third of people who used it so
about a, people used it 250 people
responded to the survey afterward for
the art project and two-thirds of that
250 or so said this was meaningful this
was a spiritual experience and they
enjoyed it so it got positive
feedback but I think they built it
wrong and the reason I think they built
it wrong is the same reason why Air
Canada went off the rails with their
bereaved customer about a year or two
ago basically Air Canada had no tool
chain safeguards in place to prevent the
AI from
hallucinating and so the AI hallucinated
a response to a bereaved customer made
up a bereavement policy that wasn't
there and ultimately there was a court
case and Air Canada was found liable for
it in the same
way if you are building a spiritual
authority figure out of AI you probably
wanted to adhere to the foundational
text of your faith which suggests to me
that the correct way to build AI Jesus
would have been a rag Model A retrieval
augmented generation model maybe they
could have used uh some of the guardrail
system that AWS used now I'm not saying
that the people who built this were
going to deploy this on AWS widely it
seems like it was a much more localized
experiment so maybe that's overbuilding
but to me at least you want to hook it
to a rag system and like stick the Bible
in the rag or something because
otherwise it would be entirely plausible
since chat
gp4 has pretty much the entirety of
spiritual writings of mankind at its
disposal to chat with AI Jesus in a
church about Buddhist texts about uh
Hindu texts anything at all and I'm not
sure that's really what the church
intended so if you're going to create a
spiritual authority figure you probably
ought to use the correct tool chain to
do so