Hello Dify Community, I'm reaching out to suggest a new feature that addresses a significant challenge in user experience when working with Dify apps, particularly during code generation tasks. Is this request related to a challenge you are facing? Yes, the issue arises when generating large content that hits the maximum output token limit, causing the generation to abruptly stop, sometimes in the middle of a code block. Users can send "continue" to get a complete result but this results in an incomplete output which cannot be easily used or copied as intended. What is the feature you'd like to see? I propose two enhancements: A "continue generation" button that appears when content generation reaches the max token limit. This button should allow users to seamlessly continue generating content within the same message. - The button text should be internationalized and customizable within Dify Studio. An optional auto-continue feature that can be enabled to automatically extend content until a complete response is generated without hitting the token limit. How will this feature improve your workflow / experience? The implementation of these features would enable smoother and uninterrupted content creation, particularly beneficial for generating extensive outputs such as long-form articles or complete code blocks without manual intervention. Additional Context or Comments This functionality is available in ChatGPT and there are open-source tools for the "auto continue" feature, indicating a clear demand for such capabilities within generative AI applications like those built on Dify. While I am not able to contribute directly to developing this feature through coding or financial sponsorship, I believe its addition would greatly enhance user satisfaction and align with existing expectations set by other AI platforms. I look forward to hearing what others think about this idea and seeing how we can make using Dify apps an even better experience!
