feat: implement summarizing conversation manager #112

stefanoamorelli · 2025-05-25T15:40:12Z

Description

Tip

Follows conventional commits. Better reviewed commit-by-commit.

Introducing a new SummarizingConversationManager as an alternative to the existing sliding window approach. It optionally uses AI-powered summarization to retain the semantic context of older messages, rather than discarding them, while staying within model context limits.

Related Issues

Closes #90

Documentation PR

strands-agents/docs#63

Type of Change

New feature

Testing

hatch fmt --linter
hatch fmt --formatter
hatch test --all
Verify that the changes do not break functionality or introduce warnings in consuming repositories: agents-docs, agents-tools, agents-cli

Checklist

I have read the CONTRIBUTING document
I have added tests that prove my fix is effective or my feature works
I have updated the documentation accordingly
I have added an appropriate example to the documentation to outline the feature
My changes generate no new warnings
Any dependent changes have been merged and published

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

src/strands/agent/conversation_manager/summarizing_conversation_manager.py

stefanoamorelli · 2025-05-27T18:45:59Z

@Unshure:

Using Agent (fallback to parent Agent if not provided) instead of Model;
Added ability to use a custom system prompt for the summarizer;
Removed the fallback to SlidingWindowConversationManager;
Improved the system prompt of the summarizer;
Kept multi-modal in the history;
Adjusted tests based on impl. and increased coverage; interactive-rebased to keep git history clean (not sure if you prefer to squash).

Let me know your feedback, I'll hold on the documentation updates until we have a final version (and before merging).

Unshure · 2025-05-29T16:07:58Z

Can you add an integration test for this implementation as well? We wand to make sure it passes end to end.

src/strands/agent/conversation_manager/summarizing_conversation_manager.py

src/strands/agent/conversation_manager/conversation_manager.py

Unshure

This is looking really good, thank you for all the work here!

src/strands/agent/conversation_manager/summarizing_conversation_manager.py

tests-integ/test_summarizing_conversation_manager_integration.py

tests/strands/agent/test_summarizing_conversation_manager.py

stefanoamorelli · 2025-06-05T21:14:47Z

@Unshure thanks for all the feedback and really appreciate your thorough review 🙏 I've pushed the changes following your comments, let me know if I addressed everything.
(I let you resolve the pending threads)

Happy to contribute and help!

Unshure

Code looks great! I was able to pull it locally and the integ tests ran much faster as well 🪄.

Few small things to clean up, and then this is good to merge!

Unshure · 2025-06-06T13:43:26Z

src/strands/agent/conversation_manager/summarizing_conversation_manager.py

+    def _message_contains_tool_use(self, message: Message) -> bool:
+        """Check if a message contains a ToolUse."""
+        return any("toolUse" in content for content in message.get("content", []))
+
+    def _message_contains_tool_result(self, message: Message) -> bool:
+        """Check if a message contains a ToolResult."""
+        return any("toolResult" in content for content in message.get("content", []))


These aren't used anymore

Unshure · 2025-06-06T13:43:50Z

src/strands/agent/conversation_manager/summarizing_conversation_manager.py

+        if split_point >= len(messages):
+            return split_point


Duplicate logic

Unshure · 2025-06-06T13:45:22Z

tests-integ/test_summarizing_conversation_manager_integration.py

+    # Verify we have tool usage in the conversation
+    has_tool_use = False
+    has_tool_result = False
+    for message in agent.messages:
+        for content in message.get("content", []):
+            if "toolUse" in content:
+                has_tool_use = True
+            if "toolResult" in content:
+                has_tool_result = True
+
+    assert has_tool_use, "Conversation should contain tool usage"
+    assert has_tool_result, "Conversation should contain tool results"


We dont need this check anymore since we manually set up the conversation

Unshure · 2025-06-06T13:49:03Z

tests-integ/test_summarizing_conversation_manager_integration.py

+    assert len(summary_text) > 30  # Should be a substantial summary
+
+    # The dedicated agent should create a structured summary
+    # (We can't assert exact content since AI responses vary, but we can check it's substantive)
+    assert any(keyword in summary_text.lower() for keyword in ["space", "exploration", "apollo", "mission"])


I would just remove this check for now. These have led to transient failures in tests which are really annoying to deal with. Im fine with just checking that the summary_text is not empty.

prestomation · 2025-06-06T17:40:23Z

src/strands/agent/conversation_manager/summarizing_conversation_manager.py

+if TYPE_CHECKING:
+    from ..agent import Agent


I'm curious what this is about?

prestomation · 2025-06-06T17:40:36Z

src/strands/agent/conversation_manager/summarizing_conversation_manager.py

+
+
+class SummarizingConversationManager(ConversationManager):
+    """Extends sliding window manager with optional summarization of older messages.


This no longer extends sliding window manager

stefanoamorelli requested a review from a team as a code owner May 25, 2025 15:40

stefanoamorelli mentioned this pull request May 25, 2025

feat: summarizing conversation manager strands-agents/docs#63

Draft

6 tasks

stefanoamorelli force-pushed the feat/summarizing-conversation-manager branch from 712e2ba to 3fa3bd7 Compare May 25, 2025 19:49

stefanoamorelli mentioned this pull request May 26, 2025

[FEATURE] Compaction Conversation Manager #90

Open

Unshure requested changes May 26, 2025

View reviewed changes

src/strands/agent/conversation_manager/summarizing_conversation_manager.py Outdated Show resolved Hide resolved

src/strands/agent/conversation_manager/summarizing_conversation_manager.py Outdated Show resolved Hide resolved

stefanoamorelli force-pushed the feat/summarizing-conversation-manager branch 2 times, most recently from 02bb209 to f90af97 Compare May 27, 2025 18:33

stefanoamorelli commented May 27, 2025

View reviewed changes

src/strands/agent/conversation_manager/summarizing_conversation_manager.py Outdated Show resolved Hide resolved

stefanoamorelli requested a review from Unshure May 27, 2025 19:06

Unshure self-assigned this May 29, 2025

Unshure requested changes May 29, 2025

View reviewed changes

stefanoamorelli force-pushed the feat/summarizing-conversation-manager branch from f90af97 to 9431bf7 Compare June 1, 2025 16:11

stefanoamorelli requested a review from Unshure June 1, 2025 16:13

Unshure mentioned this pull request Jun 2, 2025

refactor: Update conversation manager interface #161

Merged

6 tasks

stefanoamorelli force-pushed the feat/summarizing-conversation-manager branch 13 times, most recently from c0b84b2 to f1525c2 Compare June 3, 2025 21:46

Unshure requested changes Jun 4, 2025

View reviewed changes

stefanoamorelli force-pushed the feat/summarizing-conversation-manager branch 11 times, most recently from c2ea68d to 565f7ef Compare June 5, 2025 21:06

feat(summarizing_conversation_manager): implement summarization strategy

ddb29f0

stefanoamorelli force-pushed the feat/summarizing-conversation-manager branch from 565f7ef to ddb29f0 Compare June 5, 2025 21:06

stefanoamorelli requested a review from Unshure June 5, 2025 21:12

Unshure requested changes Jun 6, 2025

View reviewed changes

prestomation reviewed Jun 6, 2025

View reviewed changes



		class SummarizingConversationManager(ConversationManager):
		"""Extends sliding window manager with optional summarization of older messages.

feat: implement summarizing conversation manager #112

Are you sure you want to change the base?

feat: implement summarizing conversation manager #112

Uh oh!

Conversation

stefanoamorelli commented May 25, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description

Related Issues

Documentation PR

Type of Change

Testing

Checklist

Uh oh!

Uh oh!

Uh oh!

Uh oh!

stefanoamorelli commented May 27, 2025

Uh oh!

Unshure commented May 29, 2025

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Unshure left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

stefanoamorelli commented Jun 5, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Unshure left a comment

Choose a reason for hiding this comment

Uh oh!

Unshure Jun 6, 2025

Choose a reason for hiding this comment

Uh oh!

Unshure Jun 6, 2025

Choose a reason for hiding this comment

Uh oh!

Unshure Jun 6, 2025

Choose a reason for hiding this comment

Uh oh!

Unshure Jun 6, 2025

Choose a reason for hiding this comment

Uh oh!

prestomation Jun 6, 2025

Choose a reason for hiding this comment

Uh oh!

prestomation Jun 6, 2025

Choose a reason for hiding this comment

Uh oh!

Uh oh!

stefanoamorelli commented May 25, 2025 •

edited

Loading

stefanoamorelli commented Jun 5, 2025 •

edited

Loading