Adding an AI feature does not automatically require a new architecture. Start with one useful task and the existing application flow. Add more structure when a concrete requirement calls for it.

A model call can take longer than expected, fail, or return an answer that is unsuitable for the task. Decide how the product should respond before expanding the feature.

  • Keep the task small. A draft for someone to review may need less automation than a workflow that changes records.
  • Plan for failure. Give users a clear retry or fallback when a call cannot finish. If retries could duplicate an action, prevent that action from happening twice.
  • Check the result. A successful request does not establish that its answer is correct. Use checks that fit the task and retain human review where needed.

Move work into the background when its duration or volume makes that necessary. Let the workload justify the extra machinery.