newssite - potential fix for test

[flashdesignory]

this might fix this issue: #179

update:
simplified test and removed toast close action on the homepage.

[rniwa]

This doesn't fix the problem. As far as I can tell, this is some kind of a WebKit bug that somehow ends up loading speedometer's home page in the iframe.

[flashdesignory]

This doesn't fix the problem. As far as I can tell, this is some kind of a WebKit bug that somehow ends up loading speedometer's home page in the iframe.

Ah, that's weird. So it's not that it can't find the element on the page of the newssite, it just loads something totally different?

I can't replicate it on my machine so it's hard to debug.
Is it on certain versions of safari? any steps to repro?
How does it actually look when running? do you get that error in the console?

[rniwa]

This doesn't fix the problem. As far as I can tell, this is some kind of a WebKit bug that somehow ends up loading speedometer's home page in the iframe.

Ah, that's weird. So it's not that it can't find the element on the page of the newssite, it just loads something totally different?

Yeah, we're somehow loading Speedometer's home page after having ran previous steps. So somehow click() is triggering a navigation to home page but src stays in the news site so it's even more bizarre.

I can't replicate it on my machine so it's hard to debug. Is it on certain versions of safari? any steps to repro? How does it actually look when running? do you get that error in the console?

I can reproduce it on both Safari Technology Preview 169 as well as Safari 16.4. It's such a bizarre bug. Somehow we're replacing the contents of iframe with Speedometer's harness page in the middle of tests after having successfully ran previous steps.

[rniwa]

[rniwa]

Hm... removing failing steps won't be enough. We're now hitting this error instead at the end of TodoMVC-Angular:

[Error] SecurityError: Attempt to use history.replaceState() more than 100 times per 30 seconds
replaceState
i — vue-router.mjs:514
(anonymous function) — vue-router.mjs:483
A — vue-router.mjs:569
841 — index.js:5
d — bootstrap:19
(anonymous function) — chunk loaded:25
(anonymous function) — startup:5
Global Code — startup:5

[rniwa]

Looks like commenting out the last 3 BenchmarkTestStep would do the trick.

[flashdesignory]

Is the security error triggered by summing up the api calls from all workloads or per test?

[rniwa]

Is the security error triggered by summing up the api calls from all workloads or per test?

Yeah, it seems like the issue is that across various tests, we end up exceeding 100 requests / 30s :(

[flashdesignory]

pushed change - if you want to try it.

that security error will always be an issue the more workloads we add in that case.

[rniwa]

This "fixes" the issue for me. I should debug Safari/WebKit though. This is such a bizarre bug!

[flashdesignory]

This "fixes" the issue for me. I should debug Safari/WebKit though. This is such a bizarre bug!

awesome - i'll merge it in for now.