Pascal M
Hello Dify Community,
I'm reaching out to suggest a new feature that addresses a significant challenge in user experience when working with Dify apps, particularly during code generation tasks.
Is this request related to a challenge you are facing?
Yes, the issue arises when generating large content that hits the maximum output token limit, causing the generation to abruptly stop, sometimes in the middle of a code block. Users can send "continue" to get a complete result but this results in an incomplete output which cannot be easily used or copied as intended.
What is the feature you'd like to see?
I propose two enhancements:
  1. A "continue generation" button that appears when content generation reaches the max token limit. This button should allow users to seamlessly continue generating content within the same message.
- The button text should be internationalized and customizable within Dify Studio.
  1. An optional auto-continue feature that can be enabled to automatically extend content until a complete response is generated without hitting the token limit.
How will this feature improve your workflow / experience?
The implementation of these features would enable smoother and uninterrupted content creation, particularly beneficial for generating extensive outputs such as long-form articles or complete code blocks without manual intervention.
Additional Context or Comments
This functionality is available in ChatGPT and there are open-source tools for the "auto continue" feature, indicating a clear demand for such capabilities within generative AI applications like those built on Dify.
While I am not able to contribute directly to developing this feature through coding or financial sponsorship, I believe its addition would greatly enhance user satisfaction and align with existing expectations set by other AI platforms.
I look forward to hearing what others think about this idea and seeing how we can make using Dify apps an even better experience!
February 15, 2024