Adds TRACE_STATS_COMPUTATION_CLIENT_DROP_P0S_FALSE in system-test CI

[cbeauchesne]

Motivation

Changes

Workflow

1. ⚠️ Create your PR as draft ⚠️
2. Work on you PR until the CI passes
3. Mark it as ready for review
   • Test logic is modified? -> Get a review from RFC owner.
   • Framework is modified, or non obvious usage of it -> get a review from R&P team

🚀 Once your PR is reviewed and the CI green, you can merge it!

🛟 #apm-shared-testing 🛟

Reviewer checklist

• Anything but tests/ or manifests/ is modified ? I have the approval from R&P team
• A docker base image is modified?
  • the relevant build-XXX-image label is present
• A scenario is added, removed or renamed?
  • Get a review from R&P team

[github-actions]

CODEOWNERS have been resolved as:

.github/workflows/run-end-to-end.yml                                    @DataDog/system-tests-core
manifests/cpp_httpd.yml                                                 @DataDog/dd-trace-cpp
manifests/cpp_nginx.yml                                                 @DataDog/dd-trace-cpp

[datadog-datadog-prod-us1-2]

 

✨ Fix all issues with BitsAI

⚠️ Warnings

🚦 5 Pipeline jobs failed

Testing the test | System Tests (php, prod) / End-to-end #2 / laravel11x 2     

🧪 1 Test failed

tests.appsec.api_security.test_apisec_sampling.Test_API_Security_Sampling_Different_Endpoints.test_sampling_delay[laravel11x] from system_tests_suite  

assert False
 +  where False = all(<generator object Test_API_Security_Sampling_Different_Endpoints.test_sampling_delay.<locals>.<genexpr> at 0x7f9400700e40>)

self = <tests.appsec.api_security.test_apisec_sampling.Test_API_Security_Sampling_Different_Endpoints object at 0x7f941bf8e810>

    def test_sampling_delay(self):
        assert self.request1.status_code == 200
        schema1 = get_schema(self.request1, "req.headers")
        assert schema1 is not None
    
...

Testing the test | System Tests (python, dev) / End-to-end #1 / flask-poc 1     

🧪 2 Tests failed

tests.appsec.iast.sink.test_unvalidated_redirect.TestUnvalidatedHeader.test_secure[flask-poc] from system_tests_suite  

ValueError: Unexpected vulnerability reported: UNVALIDATED_REDIRECT

self = <tests.appsec.iast.sink.test_unvalidated_redirect.TestUnvalidatedHeader object at 0x7fe0a8aa65a0>

    def test_secure(self):
>       return super().test_secure()

tests/appsec/iast/sink/test_unvalidated_redirect.py:62: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
tests/appsec/iast/utils.py:186: in test_secure
...

tests.appsec.iast.sink.test_unvalidated_redirect.TestUnvalidatedRedirect.test_secure[flask-poc] from system_tests_suite  

ValueError: Unexpected vulnerability reported: UNVALIDATED_REDIRECT

self = <tests.appsec.iast.sink.test_unvalidated_redirect.TestUnvalidatedRedirect object at 0x7fe0a8aa6ae0>

    def test_secure(self):
>       super().test_secure()

tests/appsec/iast/sink/test_unvalidated_redirect.py:47: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
tests/appsec/iast/utils.py:186: in test_secure
...

Testing the test | System Tests (java, prod) / End-to-end #2 / akka-http 2     

🧪 2 Tests failed

tests.appsec.test_blocking_addresses.Test_Blocking_request_body_filenames.test_non_blocking[akka-http] from system_tests_suite  

ValueError: No appsec event validate this condition

self = <tests.appsec.test_blocking_addresses.Test_Blocking_request_body_filenames object at 0x7efedc909130>

    def test_non_blocking(self):
        """Does not block on server.request.body.filenames when filename is safe"""
>       self.test_blocking()

tests/appsec/test_blocking_addresses.py:615: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
...

❄️ Known flaky: tests.appsec.test_blocking_addresses.Test_Blocking_request_body_multipart.test_blocking[akka-http] from system_tests_suite  

ValueError: No appsec event validate this condition

self = <tests.appsec.test_blocking_addresses.Test_Blocking_request_body_multipart object at 0x7efedc908f20>

    def test_blocking(self):
        """Can block on server.request.body (multipart/form-data variant)"""
    
>       interfaces.library.assert_waf_attack(self.rbmp_req, rule="tst-037-004")

tests/appsec/test_blocking_addresses.py:591: 
...

Not introduced in this PR.

View all 5 failed jobs.

🧪 1 Test failed in 1 job

Testing the test | main  

tests.appsec.api_security.test_apisec_sampling.Test_API_Security_Sampling_Different_Endpoints.test_sampling_delay[laravel11x] from system_tests_suite  

assert False
 +  where False = all(<generator object Test_API_Security_Sampling_Different_Endpoints.test_sampling_delay.<locals>.<genexpr> at 0x7fa9a9bd1b60>)

self = <tests.appsec.api_security.test_apisec_sampling.Test_API_Security_Sampling_Different_Endpoints object at 0x7fa9d13abb30>

    def test_sampling_delay(self):
        assert self.request1.status_code == 200
        schema1 = get_schema(self.request1, "req.headers")
        assert schema1 is not None
    
...

ℹ️ Info

No other issues found (see more)

❄️ No new flaky tests detected

Useful? React with 👍 / 👎

_{This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 0fd369b | Docs | Datadog PR Page | Give us feedback!}