-
Notifications
You must be signed in to change notification settings - Fork 395
Closed
Labels
CITasks related to the CI, pipeline, and releasingTasks related to the CI, pipeline, and releasingbugSomething isn't workingSomething isn't workinge2e-teststeam/asterix
Milestone
Description
Expected Results
Stop E2E from failing randomly.
Observed Results
Randomly, random tests are failing locally and in the pipeline. There isn't any case, which this can be reproduced. Sometimes it works, sometimes not. We have to check if that is caused by our E2E tests, connection issues or backend problems.
Metadata
Metadata
Assignees
Labels
CITasks related to the CI, pipeline, and releasingTasks related to the CI, pipeline, and releasingbugSomething isn't workingSomething isn't workinge2e-teststeam/asterix
Type
Projects
Milestone
Relationships
Development
Select code repository
Activity
Xymmer commentedon Dec 5, 2018
moving this back in, gil is saying this still happens, sometimes, with the server;
Marcin, i can't remember why we moved this to done, do you?
wishfulthinkerme commentedon Dec 6, 2018
I couldn't reproduce random failing, so we decided to move it to the done for now.
marlass commentedon Dec 11, 2018
First we need to resolve the issue with wrong backend payment url.
Xymmer commentedon Dec 11, 2018
hey marcin, e2e fixed, can you resume investigation?
marlass commentedon Dec 18, 2018
I looked at it for a few hours and could found the real issue. Failures are completely random. One time some test fail and then it works for few runs. In the meantime, another one fails and the story repeats. Will look more at this issue in next weeks and might check some alternatives to protractor that are much more stable and easier to debug and work with. Current solution slows whole development too much. We lose way to much time on triggering pipelines and the process of writing tests is also not efficient. We need to check our work line by line and writing whole tests that just runs in the first try is almost impossible. After finding some better replacement I will introduce it to a wider audience and we will decide the e2e tests future in the project.
13 remaining items
Xymmer commentedon May 24, 2019
no longer needed as we moved from protractor to cypress