ci: 🤖 Update test matrix with new releases (07/13) by github-actions[bot] · Pull Request #6803 · getsentry/sentry-python

github-actions · 2026-07-13T04:39:18Z

Update our test matrix with new releases of integrated frameworks and libraries.

How it works

Scan PyPI for all supported releases of all frameworks we have a dedicated test suite for.
Pick a representative sample of releases to run our test suite against. We always test the latest and oldest supported version.
Update tox.ini with the new releases.

Action required

If CI passes on this PR, it's safe to approve and merge. It means our integrations can handle new versions of frameworks that got pulled in.
If CI doesn't pass on this PR, this points to an incompatibility of either our integration or our test setup with a new version of a framework.
- Check what the failures look like and either fix them, or update the test config and rerun scripts/generate-test-files.sh. See scripts/populate_tox/README.md for what configuration options are available.

🤖 This PR was automatically created using a GitHub action.

github-actions · 2026-07-13T06:40:14Z

Codecov Results 📊

📊 Comparison with Base Branch

Metric	Change
Total Tests	📉 -2304
Passed Tests	📉 -2320
Failed Tests	📈 +16
Skipped Tests	—

➕ New Tests (16)

View new tests

test_tool_execution_span[True-True]
- File: tests.integrations.openai_agents.test_openai_agents
- Status: ❌ Failing
test_tool_execution_span[True-False]
- File: tests.integrations.openai_agents.test_openai_agents
- Status: ❌ Failing
test_tool_execution_span[False-True]
- File: tests.integrations.openai_agents.test_openai_agents
- Status: ❌ Failing
test_tool_execution_span[False-False]
- File: tests.integrations.openai_agents.test_openai_agents
- Status: ❌ Failing
test_tool_execution_span[True-True]
- File: tests.integrations.openai_agents.test_openai_agents
- Status: ❌ Failing
test_tool_execution_span[True-False]
- File: tests.integrations.openai_agents.test_openai_agents
- Status: ❌ Failing
test_tool_execution_span[False-True]
- File: tests.integrations.openai_agents.test_openai_agents
- Status: ❌ Failing
test_tool_execution_span[False-False]
- File: tests.integrations.openai_agents.test_openai_agents
- Status: ❌ Failing
test_tool_execution_span[True-True]
- File: tests.integrations.openai_agents.test_openai_agents
- Status: ❌ Failing
test_tool_execution_span[True-False]
- File: tests.integrations.openai_agents.test_openai_agents
- Status: ❌ Failing
test_tool_execution_span[False-True]
- File: tests.integrations.openai_agents.test_openai_agents
- Status: ❌ Failing
test_tool_execution_span[False-False]
- File: tests.integrations.openai_agents.test_openai_agents
- Status: ❌ Failing
test_tool_execution_span[True-True]
- File: tests.integrations.openai_agents.test_openai_agents
- Status: ❌ Failing
test_tool_execution_span[True-False]
- File: tests.integrations.openai_agents.test_openai_agents
- Status: ❌ Failing
test_tool_execution_span[False-True]
- File: tests.integrations.openai_agents.test_openai_agents
- Status: ❌ Failing
test_tool_execution_span[False-False]
- File: tests.integrations.openai_agents.test_openai_agents
- Status: ❌ Failing

❌ Failed Tests

`test_tool_execution_span[True-True]`

File: tests.integrations.openai_agents.test_openai_agents
Suite: py3.10-openai_agents-v0.18.2
Error: assert [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None}] == [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}] At index 0 diff: {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None} != {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None} Full diff: [ { 'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', + 'caller': None, + 'namespace': None, 'status': None, - 'namespace': None, }, ]

Stack Trace

tests/integrations/openai_agents/test_openai_agents.py:2068: in test_tool_execution_span
    assert json.loads(
E   assert [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None}] == [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}]
E     
E     At index 0 diff: {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None} != {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}
E     
E     Full diff:
E       [
E           {
E               'arguments': '{"message": "hello"}',
E               'call_id': 'call_123',
E               'name': 'simple_test_tool',
E               'type': 'function_call',
E               'id': 'call_123',
E     +         'caller': None,
E     +         'namespace': None,
E               'status': None,
E     -         'namespace': None,
E           },
E       ]

`test_tool_execution_span[True-False]`

File: tests.integrations.openai_agents.test_openai_agents
Suite: py3.10-openai_agents-v0.18.2
Error: assert [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None}] == [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}] At index 0 diff: {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None} != {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None} Full diff: [ { 'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', + 'caller': None, + 'namespace': None, 'status': None, - 'namespace': None, }, ]

Stack Trace

tests/integrations/openai_agents/test_openai_agents.py:2300: in test_tool_execution_span
    assert json.loads(
E   assert [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None}] == [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}]
E     
E     At index 0 diff: {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None} != {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}
E     
E     Full diff:
E       [
E           {
E               'arguments': '{"message": "hello"}',
E               'call_id': 'call_123',
E               'name': 'simple_test_tool',
E               'type': 'function_call',
E               'id': 'call_123',
E     +         'caller': None,
E     +         'namespace': None,
E               'status': None,
E     -         'namespace': None,
E           },
E       ]

`test_tool_execution_span[False-True]`

File: tests.integrations.openai_agents.test_openai_agents
Suite: py3.10-openai_agents-v0.18.2
Error: assert [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None}] == [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}] At index 0 diff: {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None} != {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None} Full diff: [ { 'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', + 'caller': None, + 'namespace': None, 'status': None, - 'namespace': None, }, ]

Stack Trace

tests/integrations/openai_agents/test_openai_agents.py:2068: in test_tool_execution_span
    assert json.loads(
E   assert [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None}] == [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}]
E     
E     At index 0 diff: {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None} != {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}
E     
E     Full diff:
E       [
E           {
E               'arguments': '{"message": "hello"}',
E               'call_id': 'call_123',
E               'name': 'simple_test_tool',
E               'type': 'function_call',
E               'id': 'call_123',
E     +         'caller': None,
E     +         'namespace': None,
E               'status': None,
E     -         'namespace': None,
E           },
E       ]

`test_tool_execution_span[False-False]`

File: tests.integrations.openai_agents.test_openai_agents
Suite: py3.10-openai_agents-v0.18.2
Error: assert [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None}] == [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}] At index 0 diff: {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None} != {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None} Full diff: [ { 'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', + 'caller': None, + 'namespace': None, 'status': None, - 'namespace': None, }, ]

Stack Trace

tests/integrations/openai_agents/test_openai_agents.py:2520: in test_tool_execution_span
    assert json.loads(ai_client_span1["data"]["gen_ai.response.tool_calls"]) == [
E   assert [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None}] == [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}]
E     
E     At index 0 diff: {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None} != {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}
E     
E     Full diff:
E       [
E           {
E               'arguments': '{"message": "hello"}',
E               'call_id': 'call_123',
E               'name': 'simple_test_tool',
E               'type': 'function_call',
E               'id': 'call_123',
E     +         'caller': None,
E     +         'namespace': None,
E               'status': None,
E     -         'namespace': None,
E           },
E       ]

`test_tool_execution_span[True-True]`

File: tests.integrations.openai_agents.test_openai_agents
Suite: py3.13-openai_agents-v0.18.2
Error: assert [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None}] == [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}] At index 0 diff: {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None} != {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None} Full diff: [ { 'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', + 'caller': None, + 'namespace': None, 'status': None, - 'namespace': None, }, ]

Stack Trace

tests/integrations/openai_agents/test_openai_agents.py:2068: in test_tool_execution_span
    assert json.loads(
E   assert [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None}] == [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}]
E     
E     At index 0 diff: {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None} != {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}
E     
E     Full diff:
E       [
E           {
E               'arguments': '{"message": "hello"}',
E               'call_id': 'call_123',
E               'name': 'simple_test_tool',
E               'type': 'function_call',
E               'id': 'call_123',
E     +         'caller': None,
E     +         'namespace': None,
E               'status': None,
E     -         'namespace': None,
E           },
E       ]

`test_tool_execution_span[True-False]`

File: tests.integrations.openai_agents.test_openai_agents
Suite: py3.13-openai_agents-v0.18.2
Error: assert [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None}] == [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}] At index 0 diff: {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None} != {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None} Full diff: [ { 'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', + 'caller': None, + 'namespace': None, 'status': None, - 'namespace': None, }, ]

Stack Trace

tests/integrations/openai_agents/test_openai_agents.py:2300: in test_tool_execution_span
    assert json.loads(
E   assert [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None}] == [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}]
E     
E     At index 0 diff: {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None} != {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}
E     
E     Full diff:
E       [
E           {
E               'arguments': '{"message": "hello"}',
E               'call_id': 'call_123',
E               'name': 'simple_test_tool',
E               'type': 'function_call',
E               'id': 'call_123',
E     +         'caller': None,
E     +         'namespace': None,
E               'status': None,
E     -         'namespace': None,
E           },
E       ]

`test_tool_execution_span[False-True]`

File: tests.integrations.openai_agents.test_openai_agents
Suite: py3.13-openai_agents-v0.18.2
Error: assert [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None}] == [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}] At index 0 diff: {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None} != {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None} Full diff: [ { 'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', + 'caller': None, + 'namespace': None, 'status': None, - 'namespace': None, }, ]

Stack Trace

tests/integrations/openai_agents/test_openai_agents.py:2068: in test_tool_execution_span
    assert json.loads(
E   assert [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None}] == [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}]
E     
E     At index 0 diff: {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None} != {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}
E     
E     Full diff:
E       [
E           {
E               'arguments': '{"message": "hello"}',
E               'call_id': 'call_123',
E               'name': 'simple_test_tool',
E               'type': 'function_call',
E               'id': 'call_123',
E     +         'caller': None,
E     +         'namespace': None,
E               'status': None,
E     -         'namespace': None,
E           },
E       ]

`test_tool_execution_span[False-False]`

File: tests.integrations.openai_agents.test_openai_agents
Suite: py3.13-openai_agents-v0.18.2
Error: assert [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None}] == [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}] At index 0 diff: {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None} != {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None} Full diff: [ { 'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', + 'caller': None, + 'namespace': None, 'status': None, - 'namespace': None, }, ]

Stack Trace

tests/integrations/openai_agents/test_openai_agents.py:2520: in test_tool_execution_span
    assert json.loads(ai_client_span1["data"]["gen_ai.response.tool_calls"]) == [
E   assert [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None}] == [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}]
E     
E     At index 0 diff: {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None} != {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}
E     
E     Full diff:
E       [
E           {
E               'arguments': '{"message": "hello"}',
E               'call_id': 'call_123',
E               'name': 'simple_test_tool',
E               'type': 'function_call',
E               'id': 'call_123',
E     +         'caller': None,
E     +         'namespace': None,
E               'status': None,
E     -         'namespace': None,
E           },
E       ]

`test_tool_execution_span[True-True]`

File: tests.integrations.openai_agents.test_openai_agents
Suite: py3.14-openai_agents-v0.18.2
Error: assert [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None}] == [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}] At index 0 diff: {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None} != {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None} Full diff: [ { 'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', + 'caller': None, + 'namespace': None, 'status': None, - 'namespace': None, }, ]

Stack Trace

tests/integrations/openai_agents/test_openai_agents.py:2068: in test_tool_execution_span
    assert json.loads(
E   assert [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None}] == [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}]
E     
E     At index 0 diff: {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None} != {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}
E     
E     Full diff:
E       [
E           {
E               'arguments': '{"message": "hello"}',
E               'call_id': 'call_123',
E               'name': 'simple_test_tool',
E               'type': 'function_call',
E               'id': 'call_123',
E     +         'caller': None,
E     +         'namespace': None,
E               'status': None,
E     -         'namespace': None,
E           },
E       ]

`test_tool_execution_span[True-False]`

File: tests.integrations.openai_agents.test_openai_agents
Suite: py3.14-openai_agents-v0.18.2
Error: assert [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None}] == [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}] At index 0 diff: {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None} != {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None} Full diff: [ { 'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', + 'caller': None, + 'namespace': None, 'status': None, - 'namespace': None, }, ]

Stack Trace

tests/integrations/openai_agents/test_openai_agents.py:2300: in test_tool_execution_span
    assert json.loads(
E   assert [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None}] == [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}]
E     
E     At index 0 diff: {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None} != {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}
E     
E     Full diff:
E       [
E           {
E               'arguments': '{"message": "hello"}',
E               'call_id': 'call_123',
E               'name': 'simple_test_tool',
E               'type': 'function_call',
E               'id': 'call_123',
E     +         'caller': None,
E     +         'namespace': None,
E               'status': None,
E     -         'namespace': None,
E           },
E       ]

`test_tool_execution_span[False-True]`

File: tests.integrations.openai_agents.test_openai_agents
Suite: py3.14-openai_agents-v0.18.2
Error: assert [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None}] == [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}] At index 0 diff: {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None} != {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None} Full diff: [ { 'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', + 'caller': None, + 'namespace': None, 'status': None, - 'namespace': None, }, ]

Stack Trace

tests/integrations/openai_agents/test_openai_agents.py:2068: in test_tool_execution_span
    assert json.loads(
E   assert [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None}] == [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}]
E     
E     At index 0 diff: {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None} != {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}
E     
E     Full diff:
E       [
E           {
E               'arguments': '{"message": "hello"}',
E               'call_id': 'call_123',
E               'name': 'simple_test_tool',
E               'type': 'function_call',
E               'id': 'call_123',
E     +         'caller': None,
E     +         'namespace': None,
E               'status': None,
E     -         'namespace': None,
E           },
E       ]

`test_tool_execution_span[False-False]`

File: tests.integrations.openai_agents.test_openai_agents
Suite: py3.14-openai_agents-v0.18.2
Error: assert [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None}] == [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}] At index 0 diff: {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None} != {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None} Full diff: [ { 'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', + 'caller': None, + 'namespace': None, 'status': None, - 'namespace': None, }, ]

Stack Trace

tests/integrations/openai_agents/test_openai_agents.py:2520: in test_tool_execution_span
    assert json.loads(ai_client_span1["data"]["gen_ai.response.tool_calls"]) == [
E   assert [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None}] == [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}]
E     
E     At index 0 diff: {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None} != {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}
E     
E     Full diff:
E       [
E           {
E               'arguments': '{"message": "hello"}',
E               'call_id': 'call_123',
E               'name': 'simple_test_tool',
E               'type': 'function_call',
E               'id': 'call_123',
E     +         'caller': None,
E     +         'namespace': None,
E               'status': None,
E     -         'namespace': None,
E           },
E       ]

`test_tool_execution_span[True-True]`

File: tests.integrations.openai_agents.test_openai_agents
Suite: py3.14t-openai_agents-v0.18.2
Error: assert [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None}] == [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}] At index 0 diff: {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None} != {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None} Full diff: [ { 'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', + 'caller': None, + 'namespace': None, 'status': None, - 'namespace': None, }, ]

Stack Trace

tests/integrations/openai_agents/test_openai_agents.py:2068: in test_tool_execution_span
    assert json.loads(
E   assert [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None}] == [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}]
E     
E     At index 0 diff: {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None} != {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}
E     
E     Full diff:
E       [
E           {
E               'arguments': '{"message": "hello"}',
E               'call_id': 'call_123',
E               'name': 'simple_test_tool',
E               'type': 'function_call',
E               'id': 'call_123',
E     +         'caller': None,
E     +         'namespace': None,
E               'status': None,
E     -         'namespace': None,
E           },
E       ]

`test_tool_execution_span[True-False]`

File: tests.integrations.openai_agents.test_openai_agents
Suite: py3.14t-openai_agents-v0.18.2
Error: assert [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None}] == [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}] At index 0 diff: {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None} != {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None} Full diff: [ { 'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', + 'caller': None, + 'namespace': None, 'status': None, - 'namespace': None, }, ]

Stack Trace

tests/integrations/openai_agents/test_openai_agents.py:2300: in test_tool_execution_span
    assert json.loads(
E   assert [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None}] == [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}]
E     
E     At index 0 diff: {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None} != {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}
E     
E     Full diff:
E       [
E           {
E               'arguments': '{"message": "hello"}',
E               'call_id': 'call_123',
E               'name': 'simple_test_tool',
E               'type': 'function_call',
E               'id': 'call_123',
E     +         'caller': None,
E     +         'namespace': None,
E               'status': None,
E     -         'namespace': None,
E           },
E       ]

`test_tool_execution_span[False-True]`

File: tests.integrations.openai_agents.test_openai_agents
Suite: py3.14t-openai_agents-v0.18.2
Error: assert [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None}] == [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}] At index 0 diff: {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None} != {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None} Full diff: [ { 'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', + 'caller': None, + 'namespace': None, 'status': None, - 'namespace': None, }, ]

Stack Trace

tests/integrations/openai_agents/test_openai_agents.py:2068: in test_tool_execution_span
    assert json.loads(
E   assert [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None}] == [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}]
E     
E     At index 0 diff: {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None} != {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}
E     
E     Full diff:
E       [
E           {
E               'arguments': '{"message": "hello"}',
E               'call_id': 'call_123',
E               'name': 'simple_test_tool',
E               'type': 'function_call',
E               'id': 'call_123',
E     +         'caller': None,
E     +         'namespace': None,
E               'status': None,
E     -         'namespace': None,
E           },
E       ]

`test_tool_execution_span[False-False]`

File: tests.integrations.openai_agents.test_openai_agents
Suite: py3.14t-openai_agents-v0.18.2
Error: assert [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None}] == [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}] At index 0 diff: {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None} != {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None} Full diff: [ { 'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', + 'caller': None, + 'namespace': None, 'status': None, - 'namespace': None, }, ]

Stack Trace

tests/integrations/openai_agents/test_openai_agents.py:2520: in test_tool_execution_span
    assert json.loads(ai_client_span1["data"]["gen_ai.response.tool_calls"]) == [
E   assert [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None}] == [{'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}]
E     
E     At index 0 diff: {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'caller': None, 'namespace': None, 'status': None} != {'arguments': '{"message": "hello"}', 'call_id': 'call_123', 'name': 'simple_test_tool', 'type': 'function_call', 'id': 'call_123', 'status': None, 'namespace': None}
E     
E     Full diff:
E       [
E           {
E               'arguments': '{"message": "hello"}',
E               'call_id': 'call_123',
E               'name': 'simple_test_tool',
E               'type': 'function_call',
E               'id': 'call_123',
E     +         'caller': None,
E     +         'namespace': None,
E               'status': None,
E     -         'namespace': None,
E           },
E       ]

✅ Patch coverage is 100.00%. Project has 2515 uncovered lines.
❌ Project coverage is 89.47%. Comparing base (base) to head (head).

Coverage diff

@@            Coverage Diff             @@
##          main       #PR       +/-##
==========================================
- Coverage    89.79%    89.47%    -0.32%
==========================================
  Files          193       193         —
  Lines        23891     23891         —
  Branches      8252      8252         —
==========================================
+ Hits         21452     21376       -76
- Misses        2439      2515       +76
- Partials      1354      1348        -6

Generated by Codecov Action

ci: 🤖 Update test matrix with new releases

e2e6f6e

github-actions Bot requested a review from a team as a code owner July 13, 2026 04:39

github-actions Bot added Component: CI Component: Tests Dealing with tests labels Jul 13, 2026

empty commit to trigger ci

516fa41

Merge branch 'master' into toxgen/update-07-13

9e39c22

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

ci: 🤖 Update test matrix with new releases (07/13)#6803

ci: 🤖 Update test matrix with new releases (07/13)#6803
github-actions[bot] wants to merge 3 commits into
masterfrom
toxgen/update-07-13

github-actions Bot commented Jul 13, 2026

Uh oh!

github-actions Bot commented Jul 13, 2026 •

edited

Loading

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Uh oh!

Conversation

github-actions Bot commented Jul 13, 2026

How it works

Action required

Uh oh!

github-actions Bot commented Jul 13, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Codecov Results 📊

📊 Comparison with Base Branch

➕ New Tests (16)

❌ Failed Tests

test_tool_execution_span[True-True]

test_tool_execution_span[True-False]

test_tool_execution_span[False-True]

test_tool_execution_span[False-False]

test_tool_execution_span[True-True]

test_tool_execution_span[True-False]

test_tool_execution_span[False-True]

test_tool_execution_span[False-False]

test_tool_execution_span[True-True]

test_tool_execution_span[True-False]

test_tool_execution_span[False-True]

test_tool_execution_span[False-False]

test_tool_execution_span[True-True]

test_tool_execution_span[True-False]

test_tool_execution_span[False-True]

test_tool_execution_span[False-False]

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

github-actions Bot commented Jul 13, 2026 •

edited

Loading

`test_tool_execution_span[True-True]`

`test_tool_execution_span[True-False]`

`test_tool_execution_span[False-True]`

`test_tool_execution_span[False-False]`

`test_tool_execution_span[True-True]`

`test_tool_execution_span[True-False]`

`test_tool_execution_span[False-True]`

`test_tool_execution_span[False-False]`

`test_tool_execution_span[True-True]`

`test_tool_execution_span[True-False]`

`test_tool_execution_span[False-True]`

`test_tool_execution_span[False-False]`

`test_tool_execution_span[True-True]`

`test_tool_execution_span[True-False]`

`test_tool_execution_span[False-True]`

`test_tool_execution_span[False-False]`