Skip to content

tests: Import actionscript.all tests from gnash #22050

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

tests: Import actionscript.all tests from gnash #22050

wants to merge 1 commit into from
+126,997 −0

Conversation

@Dinnerbone
Copy link
Contributor

@Dinnerbone Dinnerbone commented Oct 26, 2025 •
edited
Loading

Once again, way too many tests to detail - sadly.

All these tests surround a specific AS2 class, and the behaviour often changes per FP version - in these cases the output is in e.g. fp10 subfolder.

All tests are ran on Windows using FP 9 -> 32. A SharedObject test was skipped as we don't have support for this in out test framework yet.

Summary is:

     Summary [  18.666s] 378 tests run: 50 passed, 328 failed
        FAIL [   0.112s] tests::tests from_gnash/actionscript.all/ASnative-v5
        FAIL [   0.134s] tests::tests from_gnash/actionscript.all/ASnative-v6
        FAIL [   0.099s] tests::tests from_gnash/actionscript.all/ASnative-v7
        FAIL [   0.144s] tests::tests from_gnash/actionscript.all/ASnative-v8
        FAIL [   0.071s] tests::tests from_gnash/actionscript.all/Accessibility-v5
        FAIL [   0.122s] tests::tests from_gnash/actionscript.all/AsBroadcaster-v5
        FAIL [   0.075s] tests::tests from_gnash/actionscript.all/AsBroadcaster-v6
        FAIL [   0.104s] tests::tests from_gnash/actionscript.all/AsBroadcaster-v7
        FAIL [   0.071s] tests::tests from_gnash/actionscript.all/AsBroadcaster-v8
        FAIL [   0.134s] tests::tests from_gnash/actionscript.all/BitmapData-v5
        FAIL [   0.081s] tests::tests from_gnash/actionscript.all/BitmapData-v6
        FAIL [   0.071s] tests::tests from_gnash/actionscript.all/BitmapData-v7
        FAIL [   0.346s] tests::tests from_gnash/actionscript.all/BitmapData-v8
        FAIL [   0.113s] tests::tests from_gnash/actionscript.all/Boolean-v5
        FAIL [   0.062s] tests::tests from_gnash/actionscript.all/Camera-v5
        FAIL [   0.108s] tests::tests from_gnash/actionscript.all/Camera-v6
        FAIL [   0.089s] tests::tests from_gnash/actionscript.all/Camera-v7
        FAIL [   0.098s] tests::tests from_gnash/actionscript.all/Camera-v8
        FAIL [   0.113s] tests::tests from_gnash/actionscript.all/Color-v5
        FAIL [   0.073s] tests::tests from_gnash/actionscript.all/ColorTransform-v5
        FAIL [   0.070s] tests::tests from_gnash/actionscript.all/ColorTransform-v6
        FAIL [   0.071s] tests::tests from_gnash/actionscript.all/ColorTransform-v7
        FAIL [   0.107s] tests::tests from_gnash/actionscript.all/ColorTransform-v8
        FAIL [   0.090s] tests::tests from_gnash/actionscript.all/ContextMenu-v7
        FAIL [   0.073s] tests::tests from_gnash/actionscript.all/ContextMenu-v8
        FAIL [   0.102s] tests::tests from_gnash/actionscript.all/Date-v5/fp10
        FAIL [   0.105s] tests::tests from_gnash/actionscript.all/Date-v5/fp9
        FAIL [   0.090s] tests::tests from_gnash/actionscript.all/Date-v6/fp10
        FAIL [   0.100s] tests::tests from_gnash/actionscript.all/Date-v6/fp9
        FAIL [   0.100s] tests::tests from_gnash/actionscript.all/Date-v7/fp10
        FAIL [   0.093s] tests::tests from_gnash/actionscript.all/Date-v7/fp9
        FAIL [   0.087s] tests::tests from_gnash/actionscript.all/Date-v8/fp10
        FAIL [   0.089s] tests::tests from_gnash/actionscript.all/Date-v8/fp9
        FAIL [   0.098s] tests::tests from_gnash/actionscript.all/Error-v5
        FAIL [   0.096s] tests::tests from_gnash/actionscript.all/Error-v6
        FAIL [   0.071s] tests::tests from_gnash/actionscript.all/Error-v7
        FAIL [   0.104s] tests::tests from_gnash/actionscript.all/Error-v8
        FAIL [   0.113s] tests::tests from_gnash/actionscript.all/ExternalInterface-v5
        FAIL [   0.072s] tests::tests from_gnash/actionscript.all/ExternalInterface-v6
        FAIL [   0.089s] tests::tests from_gnash/actionscript.all/ExternalInterface-v7
        FAIL [   0.086s] tests::tests from_gnash/actionscript.all/ExternalInterface-v8
        FAIL [   0.091s] tests::tests from_gnash/actionscript.all/Function-v5/fp13
        FAIL [   0.085s] tests::tests from_gnash/actionscript.all/Function-v5/fp14
        FAIL [   0.073s] tests::tests from_gnash/actionscript.all/Function-v5/fp18
        FAIL [   0.085s] tests::tests from_gnash/actionscript.all/Function-v5/fp9
        FAIL [   0.084s] tests::tests from_gnash/actionscript.all/Function-v6/fp13
        FAIL [   0.105s] tests::tests from_gnash/actionscript.all/Function-v6/fp14
        FAIL [   0.138s] tests::tests from_gnash/actionscript.all/Function-v6/fp18
        FAIL [   0.086s] tests::tests from_gnash/actionscript.all/Function-v6/fp24
        FAIL [   0.122s] tests::tests from_gnash/actionscript.all/Function-v6/fp9
        FAIL [   0.098s] tests::tests from_gnash/actionscript.all/Function-v7/fp13
        FAIL [   0.117s] tests::tests from_gnash/actionscript.all/Function-v7/fp14
        FAIL [   0.134s] tests::tests from_gnash/actionscript.all/Function-v7/fp18
        FAIL [   0.116s] tests::tests from_gnash/actionscript.all/Function-v7/fp24
        FAIL [   0.102s] tests::tests from_gnash/actionscript.all/Function-v7/fp9
        FAIL [   0.092s] tests::tests from_gnash/actionscript.all/Function-v8/fp13
        FAIL [   0.085s] tests::tests from_gnash/actionscript.all/Function-v8/fp14
        FAIL [   0.081s] tests::tests from_gnash/actionscript.all/Function-v8/fp18
        FAIL [   0.082s] tests::tests from_gnash/actionscript.all/Function-v8/fp24
        FAIL [   0.089s] tests::tests from_gnash/actionscript.all/Function-v8/fp9
        FAIL [   0.088s] tests::tests from_gnash/actionscript.all/Global-v5/fp10
        FAIL [   0.087s] tests::tests from_gnash/actionscript.all/Global-v5/fp11
        FAIL [   0.076s] tests::tests from_gnash/actionscript.all/Global-v5/fp9
        FAIL [   0.075s] tests::tests from_gnash/actionscript.all/Global-v6
        FAIL [   0.071s] tests::tests from_gnash/actionscript.all/Global-v7
        FAIL [   0.082s] tests::tests from_gnash/actionscript.all/Global-v8
        FAIL [   0.086s] tests::tests from_gnash/actionscript.all/HitTest-v6
        FAIL [   0.085s] tests::tests from_gnash/actionscript.all/HitTest-v7
        FAIL [   0.064s] tests::tests from_gnash/actionscript.all/HitTest-v8
        FAIL [   0.077s] tests::tests from_gnash/actionscript.all/Inheritance-v5
        FAIL [   0.081s] tests::tests from_gnash/actionscript.all/Inheritance-v6
        FAIL [   0.078s] tests::tests from_gnash/actionscript.all/Inheritance-v7
        FAIL [   0.095s] tests::tests from_gnash/actionscript.all/Inheritance-v8
        FAIL [   0.075s] tests::tests from_gnash/actionscript.all/Instance-v5
        FAIL [   0.104s] tests::tests from_gnash/actionscript.all/Instance-v6
        FAIL [   0.089s] tests::tests from_gnash/actionscript.all/Instance-v7
        FAIL [   0.069s] tests::tests from_gnash/actionscript.all/Instance-v8
        FAIL [   0.084s] tests::tests from_gnash/actionscript.all/Key-v5
        FAIL [   0.104s] tests::tests from_gnash/actionscript.all/LoadVars-v6
        FAIL [   0.113s] tests::tests from_gnash/actionscript.all/LoadVars-v7
        FAIL [   0.084s] tests::tests from_gnash/actionscript.all/LoadVars-v8
        FAIL [   0.072s] tests::tests from_gnash/actionscript.all/LocalConnection-v5
        FAIL [   0.068s] tests::tests from_gnash/actionscript.all/LocalConnection-v6
        FAIL [   0.080s] tests::tests from_gnash/actionscript.all/LocalConnection-v7
        FAIL [   0.084s] tests::tests from_gnash/actionscript.all/LocalConnection-v8
        FAIL [   0.077s] tests::tests from_gnash/actionscript.all/Math-v5
        FAIL [   0.102s] tests::tests from_gnash/actionscript.all/Math-v6
        FAIL [   0.090s] tests::tests from_gnash/actionscript.all/Math-v7
        FAIL [   0.100s] tests::tests from_gnash/actionscript.all/Math-v8
        FAIL [   0.066s] tests::tests from_gnash/actionscript.all/Matrix-v5
        FAIL [   0.147s] tests::tests from_gnash/actionscript.all/Matrix-v6
        FAIL [   0.112s] tests::tests from_gnash/actionscript.all/Matrix-v7
        FAIL [   0.123s] tests::tests from_gnash/actionscript.all/Matrix-v8
        FAIL [   0.106s] tests::tests from_gnash/actionscript.all/Microphone-v6
        FAIL [   0.099s] tests::tests from_gnash/actionscript.all/Microphone-v7
        FAIL [   0.129s] tests::tests from_gnash/actionscript.all/Microphone-v8
        FAIL [   0.117s] tests::tests from_gnash/actionscript.all/MovieClip-v5
        FAIL [   0.150s] tests::tests from_gnash/actionscript.all/MovieClip-v6/fp10
        FAIL [   0.143s] tests::tests from_gnash/actionscript.all/MovieClip-v6/fp13
        FAIL [   0.144s] tests::tests from_gnash/actionscript.all/MovieClip-v6/fp14
        FAIL [   0.138s] tests::tests from_gnash/actionscript.all/MovieClip-v6/fp16
        FAIL [   0.203s] tests::tests from_gnash/actionscript.all/MovieClip-v6/fp19
        FAIL [   0.149s] tests::tests from_gnash/actionscript.all/MovieClip-v6/fp21
        FAIL [   0.186s] tests::tests from_gnash/actionscript.all/MovieClip-v6/fp23
        FAIL [   0.137s] tests::tests from_gnash/actionscript.all/MovieClip-v6/fp9
        FAIL [   0.131s] tests::tests from_gnash/actionscript.all/MovieClip-v7/fp10
        FAIL [   0.120s] tests::tests from_gnash/actionscript.all/MovieClip-v7/fp13
        FAIL [   0.142s] tests::tests from_gnash/actionscript.all/MovieClip-v7/fp14
        FAIL [   0.148s] tests::tests from_gnash/actionscript.all/MovieClip-v7/fp16
        FAIL [   0.152s] tests::tests from_gnash/actionscript.all/MovieClip-v7/fp19
        FAIL [   0.149s] tests::tests from_gnash/actionscript.all/MovieClip-v7/fp21
        FAIL [   0.161s] tests::tests from_gnash/actionscript.all/MovieClip-v7/fp23
        FAIL [   0.193s] tests::tests from_gnash/actionscript.all/MovieClip-v7/fp9
        FAIL [   0.179s] tests::tests from_gnash/actionscript.all/MovieClip-v8/fp10
        FAIL [   0.162s] tests::tests from_gnash/actionscript.all/MovieClip-v8/fp13
        FAIL [   0.181s] tests::tests from_gnash/actionscript.all/MovieClip-v8/fp14
        FAIL [   0.157s] tests::tests from_gnash/actionscript.all/MovieClip-v8/fp16
        FAIL [   0.162s] tests::tests from_gnash/actionscript.all/MovieClip-v8/fp19
        FAIL [   0.177s] tests::tests from_gnash/actionscript.all/MovieClip-v8/fp21
        FAIL [   0.185s] tests::tests from_gnash/actionscript.all/MovieClip-v8/fp23
        FAIL [   0.162s] tests::tests from_gnash/actionscript.all/MovieClip-v8/fp9
        FAIL [   0.099s] tests::tests from_gnash/actionscript.all/MovieClipLoader-v7
        FAIL [   0.078s] tests::tests from_gnash/actionscript.all/MovieClipLoader-v8
        FAIL [   0.068s] tests::tests from_gnash/actionscript.all/NetConnection-v5
        FAIL [   0.124s] tests::tests from_gnash/actionscript.all/NetConnection-v6/fp30
        FAIL [   0.083s] tests::tests from_gnash/actionscript.all/NetConnection-v6/fp9
        FAIL [   0.079s] tests::tests from_gnash/actionscript.all/NetConnection-v7/fp30
        FAIL [   0.074s] tests::tests from_gnash/actionscript.all/NetConnection-v7/fp9
        FAIL [   0.100s] tests::tests from_gnash/actionscript.all/NetConnection-v8/fp30
        FAIL [   0.073s] tests::tests from_gnash/actionscript.all/NetConnection-v8/fp9
        FAIL [   0.082s] tests::tests from_gnash/actionscript.all/NetStream-v6
        FAIL [   0.081s] tests::tests from_gnash/actionscript.all/NetStream-v7
        FAIL [   0.085s] tests::tests from_gnash/actionscript.all/NetStream-v8
        FAIL [   0.088s] tests::tests from_gnash/actionscript.all/Number-v5
        FAIL [   0.088s] tests::tests from_gnash/actionscript.all/Number-v6
        FAIL [   0.077s] tests::tests from_gnash/actionscript.all/Number-v7
        FAIL [   0.089s] tests::tests from_gnash/actionscript.all/Number-v8
        FAIL [   0.084s] tests::tests from_gnash/actionscript.all/Object-v5/fp18
        FAIL [   0.069s] tests::tests from_gnash/actionscript.all/Object-v5/fp19
        FAIL [   0.077s] tests::tests from_gnash/actionscript.all/Object-v5/fp20
        FAIL [   0.062s] tests::tests from_gnash/actionscript.all/Object-v5/fp9
        FAIL [   0.125s] tests::tests from_gnash/actionscript.all/Object-v6/fp18
        FAIL [   0.129s] tests::tests from_gnash/actionscript.all/Object-v6/fp19
        FAIL [   0.126s] tests::tests from_gnash/actionscript.all/Object-v6/fp20
        FAIL [   0.126s] tests::tests from_gnash/actionscript.all/Object-v6/fp9
        FAIL [   0.147s] tests::tests from_gnash/actionscript.all/Object-v7/fp18
        FAIL [   0.117s] tests::tests from_gnash/actionscript.all/Object-v7/fp19
        FAIL [   0.141s] tests::tests from_gnash/actionscript.all/Object-v7/fp20
        FAIL [   0.170s] tests::tests from_gnash/actionscript.all/Object-v7/fp9
        FAIL [   0.129s] tests::tests from_gnash/actionscript.all/Object-v8/fp18
        FAIL [   0.142s] tests::tests from_gnash/actionscript.all/Object-v8/fp19
        FAIL [   0.129s] tests::tests from_gnash/actionscript.all/Object-v8/fp20
        FAIL [   0.152s] tests::tests from_gnash/actionscript.all/Object-v8/fp9
        FAIL [   0.076s] tests::tests from_gnash/actionscript.all/Point-v5
        FAIL [   0.076s] tests::tests from_gnash/actionscript.all/Point-v6
        FAIL [   0.090s] tests::tests from_gnash/actionscript.all/Point-v7
        FAIL [   0.095s] tests::tests from_gnash/actionscript.all/Point-v8
        FAIL [   0.071s] tests::tests from_gnash/actionscript.all/Rectangle-v5
        FAIL [   0.076s] tests::tests from_gnash/actionscript.all/Rectangle-v6
        FAIL [   0.071s] tests::tests from_gnash/actionscript.all/Rectangle-v7
        FAIL [   0.099s] tests::tests from_gnash/actionscript.all/Rectangle-v8
        FAIL [   0.127s] tests::tests from_gnash/actionscript.all/Selection-v6
        FAIL [   0.086s] tests::tests from_gnash/actionscript.all/Selection-v7
        FAIL [   0.080s] tests::tests from_gnash/actionscript.all/Selection-v8
        FAIL [   0.080s] tests::tests from_gnash/actionscript.all/Sound-v5
        FAIL [   0.100s] tests::tests from_gnash/actionscript.all/Sound-v6
        FAIL [   0.080s] tests::tests from_gnash/actionscript.all/Sound-v7
        FAIL [   0.104s] tests::tests from_gnash/actionscript.all/Sound-v8
        FAIL [   0.077s] tests::tests from_gnash/actionscript.all/Stage-v5
        FAIL [   0.095s] tests::tests from_gnash/actionscript.all/Stage-v6/fp10
        FAIL [   0.110s] tests::tests from_gnash/actionscript.all/Stage-v6/fp32
        FAIL [   0.092s] tests::tests from_gnash/actionscript.all/Stage-v6/fp9
        FAIL [   0.086s] tests::tests from_gnash/actionscript.all/Stage-v7/fp10
        FAIL [   0.079s] tests::tests from_gnash/actionscript.all/Stage-v7/fp32
        FAIL [   0.100s] tests::tests from_gnash/actionscript.all/Stage-v7/fp9
        FAIL [   0.070s] tests::tests from_gnash/actionscript.all/Stage-v8/fp10
        FAIL [   0.086s] tests::tests from_gnash/actionscript.all/Stage-v8/fp32
        FAIL [   0.074s] tests::tests from_gnash/actionscript.all/Stage-v8/fp9
        FAIL [   0.107s] tests::tests from_gnash/actionscript.all/String-v5
        FAIL [   0.128s] tests::tests from_gnash/actionscript.all/String-v6
        FAIL [   0.104s] tests::tests from_gnash/actionscript.all/String-v7
        FAIL [   0.129s] tests::tests from_gnash/actionscript.all/String-v8
        FAIL [   0.102s] tests::tests from_gnash/actionscript.all/System-v5
        FAIL [   0.105s] tests::tests from_gnash/actionscript.all/System-v6
        FAIL [   0.085s] tests::tests from_gnash/actionscript.all/System-v7
        FAIL [   0.107s] tests::tests from_gnash/actionscript.all/System-v8
        FAIL [   0.092s] tests::tests from_gnash/actionscript.all/TextField-v5
        FAIL [   0.129s] tests::tests from_gnash/actionscript.all/TextField-v6/fp13
        FAIL [   0.116s] tests::tests from_gnash/actionscript.all/TextField-v6/fp14
        FAIL [   0.125s] tests::tests from_gnash/actionscript.all/TextField-v6/fp16
        FAIL [   0.128s] tests::tests from_gnash/actionscript.all/TextField-v6/fp17
        FAIL [   0.125s] tests::tests from_gnash/actionscript.all/TextField-v6/fp9
        FAIL [   0.209s] tests::tests from_gnash/actionscript.all/TextField-v7/fp13
        FAIL [   0.122s] tests::tests from_gnash/actionscript.all/TextField-v7/fp14
        FAIL [   0.173s] tests::tests from_gnash/actionscript.all/TextField-v7/fp16
        FAIL [   0.141s] tests::tests from_gnash/actionscript.all/TextField-v7/fp17
        FAIL [   0.145s] tests::tests from_gnash/actionscript.all/TextField-v7/fp9
        FAIL [   0.142s] tests::tests from_gnash/actionscript.all/TextField-v8/fp13
        FAIL [   0.167s] tests::tests from_gnash/actionscript.all/TextField-v8/fp14
        FAIL [   0.162s] tests::tests from_gnash/actionscript.all/TextField-v8/fp16
        FAIL [   0.138s] tests::tests from_gnash/actionscript.all/TextField-v8/fp17
        FAIL [   0.117s] tests::tests from_gnash/actionscript.all/TextField-v8/fp9
        FAIL [   0.071s] tests::tests from_gnash/actionscript.all/TextFieldHTML-v6
        FAIL [   0.077s] tests::tests from_gnash/actionscript.all/TextFieldHTML-v7
        FAIL [   0.088s] tests::tests from_gnash/actionscript.all/TextFieldHTML-v8
        FAIL [   0.108s] tests::tests from_gnash/actionscript.all/TextFormat-v5
        FAIL [   0.068s] tests::tests from_gnash/actionscript.all/TextFormat-v6
        FAIL [   0.118s] tests::tests from_gnash/actionscript.all/TextFormat-v7
        FAIL [   0.088s] tests::tests from_gnash/actionscript.all/TextFormat-v8/fp10
        FAIL [   0.100s] tests::tests from_gnash/actionscript.all/TextFormat-v8/fp9
        FAIL [   0.069s] tests::tests from_gnash/actionscript.all/TextSnapshot-v5
        FAIL [   0.155s] tests::tests from_gnash/actionscript.all/TextSnapshot-v6
        FAIL [   0.088s] tests::tests from_gnash/actionscript.all/TextSnapshot-v7
        FAIL [   0.125s] tests::tests from_gnash/actionscript.all/TextSnapshot-v8
        FAIL [   0.065s] tests::tests from_gnash/actionscript.all/Transform-v5
        FAIL [   0.091s] tests::tests from_gnash/actionscript.all/Transform-v8/fp10
        FAIL [   0.085s] tests::tests from_gnash/actionscript.all/Transform-v8/fp9
        FAIL [   0.075s] tests::tests from_gnash/actionscript.all/Video-v6
        FAIL [   0.100s] tests::tests from_gnash/actionscript.all/Video-v7
        FAIL [   0.114s] tests::tests from_gnash/actionscript.all/Video-v8
        FAIL [   0.152s] tests::tests from_gnash/actionscript.all/XML-v5/fp10
        FAIL [   0.117s] tests::tests from_gnash/actionscript.all/XML-v5/fp9
        FAIL [   0.127s] tests::tests from_gnash/actionscript.all/XML-v6/fp10
        FAIL [   0.119s] tests::tests from_gnash/actionscript.all/XML-v6/fp9
        FAIL [   0.112s] tests::tests from_gnash/actionscript.all/XML-v7/fp10
        FAIL [   0.126s] tests::tests from_gnash/actionscript.all/XML-v7/fp9
        FAIL [   0.108s] tests::tests from_gnash/actionscript.all/XML-v8/fp10
        FAIL [   0.162s] tests::tests from_gnash/actionscript.all/XML-v8/fp9
        FAIL [   0.085s] tests::tests from_gnash/actionscript.all/XMLNode-v5/fp10
        FAIL [   0.105s] tests::tests from_gnash/actionscript.all/XMLNode-v5/fp11
        FAIL [   0.093s] tests::tests from_gnash/actionscript.all/XMLNode-v5/fp9
        FAIL [   0.071s] tests::tests from_gnash/actionscript.all/XMLNode-v6/fp10
        FAIL [   0.120s] tests::tests from_gnash/actionscript.all/XMLNode-v6/fp11
        FAIL [   0.113s] tests::tests from_gnash/actionscript.all/XMLNode-v6/fp9
        FAIL [   0.079s] tests::tests from_gnash/actionscript.all/XMLNode-v7/fp10
        FAIL [   0.097s] tests::tests from_gnash/actionscript.all/XMLNode-v7/fp11
        FAIL [   0.083s] tests::tests from_gnash/actionscript.all/XMLNode-v7/fp9
        FAIL [   0.106s] tests::tests from_gnash/actionscript.all/XMLNode-v8/fp10
        FAIL [   0.123s] tests::tests from_gnash/actionscript.all/XMLNode-v8/fp9
        FAIL [   0.063s] tests::tests from_gnash/actionscript.all/XMLSocket-v5
        FAIL [   0.060s] tests::tests from_gnash/actionscript.all/XMLSocket-v6
        FAIL [   0.071s] tests::tests from_gnash/actionscript.all/XMLSocket-v7
        FAIL [   0.071s] tests::tests from_gnash/actionscript.all/XMLSocket-v8
        FAIL [   0.203s] tests::tests from_gnash/actionscript.all/argstest-v5
        FAIL [   0.228s] tests::tests from_gnash/actionscript.all/argstest-v6/fp10
        FAIL [   0.179s] tests::tests from_gnash/actionscript.all/argstest-v6/fp11
        FAIL [   0.197s] tests::tests from_gnash/actionscript.all/argstest-v6/fp13
        FAIL [   0.185s] tests::tests from_gnash/actionscript.all/argstest-v6/fp14
        FAIL [   0.204s] tests::tests from_gnash/actionscript.all/argstest-v6/fp18
        FAIL [   0.198s] tests::tests from_gnash/actionscript.all/argstest-v6/fp32
        FAIL [   0.190s] tests::tests from_gnash/actionscript.all/argstest-v6/fp9
        FAIL [   0.185s] tests::tests from_gnash/actionscript.all/argstest-v7/fp10
        FAIL [   0.309s] tests::tests from_gnash/actionscript.all/argstest-v7/fp11
        FAIL [   0.182s] tests::tests from_gnash/actionscript.all/argstest-v7/fp13
        FAIL [   0.201s] tests::tests from_gnash/actionscript.all/argstest-v7/fp14
        FAIL [   0.272s] tests::tests from_gnash/actionscript.all/argstest-v7/fp18
        FAIL [   0.177s] tests::tests from_gnash/actionscript.all/argstest-v7/fp32
        FAIL [   0.154s] tests::tests from_gnash/actionscript.all/argstest-v7/fp9
        FAIL [   0.188s] tests::tests from_gnash/actionscript.all/argstest-v8/fp11
        FAIL [   0.201s] tests::tests from_gnash/actionscript.all/argstest-v8/fp13
        FAIL [   0.201s] tests::tests from_gnash/actionscript.all/argstest-v8/fp14
        FAIL [   0.192s] tests::tests from_gnash/actionscript.all/argstest-v8/fp18
        FAIL [   0.180s] tests::tests from_gnash/actionscript.all/argstest-v8/fp32
        FAIL [   0.090s] tests::tests from_gnash/actionscript.all/array-v5
        FAIL [   0.107s] tests::tests from_gnash/actionscript.all/array-v6/fp13
        FAIL [   0.113s] tests::tests from_gnash/actionscript.all/array-v6/fp14
        FAIL [   0.151s] tests::tests from_gnash/actionscript.all/array-v6/fp17
        FAIL [   0.220s] tests::tests from_gnash/actionscript.all/array-v6/fp24
        FAIL [   0.135s] tests::tests from_gnash/actionscript.all/array-v6/fp9
        FAIL [   0.124s] tests::tests from_gnash/actionscript.all/array-v7/fp13
        FAIL [   0.099s] tests::tests from_gnash/actionscript.all/array-v7/fp14
        FAIL [   0.115s] tests::tests from_gnash/actionscript.all/array-v7/fp17
        FAIL [   0.189s] tests::tests from_gnash/actionscript.all/array-v7/fp24
        FAIL [   0.132s] tests::tests from_gnash/actionscript.all/array-v7/fp9
        FAIL [   0.133s] tests::tests from_gnash/actionscript.all/array-v8/fp13
        FAIL [   0.140s] tests::tests from_gnash/actionscript.all/array-v8/fp14
        FAIL [   0.125s] tests::tests from_gnash/actionscript.all/array-v8/fp17
        FAIL [   0.127s] tests::tests from_gnash/actionscript.all/array-v8/fp24
        FAIL [   0.152s] tests::tests from_gnash/actionscript.all/array-v8/fp9
        FAIL [   0.066s] tests::tests from_gnash/actionscript.all/case-v6
        FAIL [   0.101s] tests::tests from_gnash/actionscript.all/case-v7
        FAIL [   0.067s] tests::tests from_gnash/actionscript.all/case-v8
        FAIL [  17.496s] tests::tests from_gnash/actionscript.all/caseconv-v6/fp9
        FAIL [  17.317s] tests::tests from_gnash/actionscript.all/caseconv-v7/fp9
        FAIL [  17.387s] tests::tests from_gnash/actionscript.all/caseconv-v8/fp9
        FAIL [   0.075s] tests::tests from_gnash/actionscript.all/delete-v5
        FAIL [   0.065s] tests::tests from_gnash/actionscript.all/delete-v6
        FAIL [   0.081s] tests::tests from_gnash/actionscript.all/delete-v7
        FAIL [   0.101s] tests::tests from_gnash/actionscript.all/delete-v8
        FAIL [   0.057s] tests::tests from_gnash/actionscript.all/flash-v5
        FAIL [   0.101s] tests::tests from_gnash/actionscript.all/flash-v6
        FAIL [   0.070s] tests::tests from_gnash/actionscript.all/flash-v7
        FAIL [   0.085s] tests::tests from_gnash/actionscript.all/flash-v8/fp10
        FAIL [   0.085s] tests::tests from_gnash/actionscript.all/flash-v8/fp9
        FAIL [   0.059s] tests::tests from_gnash/actionscript.all/getvariable-v5/fp10
        FAIL [   0.064s] tests::tests from_gnash/actionscript.all/getvariable-v5/fp9
        FAIL [   0.072s] tests::tests from_gnash/actionscript.all/getvariable-v6/fp10
        FAIL [   0.084s] tests::tests from_gnash/actionscript.all/getvariable-v6/fp9
        FAIL [   0.072s] tests::tests from_gnash/actionscript.all/getvariable-v7/fp10
        FAIL [   0.053s] tests::tests from_gnash/actionscript.all/getvariable-v7/fp9
        FAIL [   0.074s] tests::tests from_gnash/actionscript.all/getvariable-v8/fp10
        FAIL [   0.076s] tests::tests from_gnash/actionscript.all/getvariable-v8/fp9
        FAIL [   0.116s] tests::tests from_gnash/actionscript.all/ops-v5/fp10
        FAIL [   0.090s] tests::tests from_gnash/actionscript.all/ops-v5/fp9
        FAIL [   0.109s] tests::tests from_gnash/actionscript.all/ops-v6/fp10
        FAIL [   0.094s] tests::tests from_gnash/actionscript.all/ops-v6/fp9
        FAIL [   0.105s] tests::tests from_gnash/actionscript.all/ops-v7/fp10
        FAIL [   0.111s] tests::tests from_gnash/actionscript.all/ops-v7/fp9
        FAIL [   0.070s] tests::tests from_gnash/actionscript.all/ops-v8
        FAIL [   0.095s] tests::tests from_gnash/actionscript.all/setProperty-v5/fp10
        FAIL [   0.069s] tests::tests from_gnash/actionscript.all/setProperty-v5/fp9
        FAIL [   0.073s] tests::tests from_gnash/actionscript.all/setProperty-v6/fp10
        FAIL [   0.070s] tests::tests from_gnash/actionscript.all/setProperty-v6/fp9
        FAIL [   0.068s] tests::tests from_gnash/actionscript.all/setProperty-v7/fp10
        FAIL [   0.070s] tests::tests from_gnash/actionscript.all/setProperty-v7/fp9
        FAIL [   0.064s] tests::tests from_gnash/actionscript.all/setProperty-v8/fp10
        FAIL [   0.069s] tests::tests from_gnash/actionscript.all/setProperty-v8/fp9
        FAIL [   0.058s] tests::tests from_gnash/actionscript.all/targetPath-v6
        FAIL [   0.062s] tests::tests from_gnash/actionscript.all/targetPath-v7
        FAIL [   0.059s] tests::tests from_gnash/actionscript.all/targetPath-v8
        FAIL [   0.074s] tests::tests from_gnash/actionscript.all/toString_valueOf-v5
        FAIL [   0.057s] tests::tests from_gnash/actionscript.all/toString_valueOf-v6
        FAIL [   0.061s] tests::tests from_gnash/actionscript.all/toString_valueOf-v7
        FAIL [   0.050s] tests::tests from_gnash/actionscript.all/toString_valueOf-v8
        FAIL [   0.043s] tests::tests from_gnash/actionscript.all/with-v5
        FAIL [   0.050s] tests::tests from_gnash/actionscript.all/with-v6
        FAIL [   0.041s] tests::tests from_gnash/actionscript.all/with-v7
        FAIL [   0.033s] tests::tests from_gnash/actionscript.all/with-v8

@Dinnerbone Dinnerbone added A-tests Area: Tests & Test Framework T-chore Type: Chore (like updating a dependency, it's gotta be done) labels Oct 26, 2025
@Dinnerbone Dinnerbone mentioned this pull request Oct 26, 2025
Merged
@kjarosh
Copy link
Member

kjarosh commented Oct 27, 2025 •
edited
Loading

Some tests fail when running coverage:

from_gnash/actionscript.all/caseconv-v7/fp10
from_gnash/actionscript.all/caseconv-v6/fp10
from_gnash/actionscript.all/caseconv-v8/fp10

They actually fail locally too for me.

@kjarosh
Copy link
Member

kjarosh commented Oct 27, 2025

I think something's wrong with the caseconv tests, their execution time is super high and they fail on some platforms. Those tests usually do tens of thousands of iterations checking all integer values, which may be an overkill here especially that on some FP versions, tests fail for a lot of integers, causing thousands of failures and lines in output.txt.

We might want to write them in such a way that they rarely produce output, or (better IMO) modify them not to iterate over all integers, but only over edge cases.

@kjarosh
Copy link
Member

kjarosh commented Oct 27, 2025

Regarding TextField tests, did you make sure to install the exact same Noto Sans from the .ttf file committed to the repo before running the tests? Noto Sans differs across distributions, so the .ttf must be the exact same used by FP.

@Dinnerbone
Copy link
Contributor Author

Regarding TextField tests, did you make sure to install the exact same Noto Sans from the .ttf file committed to the repo before running the tests? Noto Sans differs across distributions, so the .ttf must be the exact same used by FP.

Yes. That exact ttf file was used on Windows to replace Times New Roman for those tests.

@Dinnerbone
Copy link
Contributor Author

Let's remove caseconv for now to unblock the rest of the tests, whilst we think of something better there

@kjarosh
Copy link
Member

kjarosh commented Oct 27, 2025

Yes. That exact ttf file was used on Windows to replace Times New Roman for those tests.

On Windows? IIUC FP does not use fontconfig on Windows, no?

@Dinnerbone
Copy link
Contributor Author

Yes. That exact ttf file was used on Windows to replace Times New Roman for those tests.

On Windows? IIUC FP does not use fontconfig on Windows, no?

Correct, I had to rename the font to Times New Roman, install it as a user font, and verify that the values changed when I did so, so it's picking up the custom font instead of the system font.

@Dinnerbone Dinnerbone mentioned this pull request Oct 27, 2025
Open
@kjarosh
Copy link
Member

kjarosh commented Oct 28, 2025 •
edited
Loading

I did some perf testing of those tests, and:

  • caseconv takes around 32 min of workload,
  • argstest takes around 21 min of workload,
  • the rest of 352 tests take around 3.7 min of workload.

I think we should drop argstest too until we come up with something (marking slow tests and running them once per day, etc.).

BitmapData-v8 and MovieClip-v8 are large too, but acceptable (6 s, 14 s).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

A-tests Area: Tests & Test Framework T-chore Type: Chore (like updating a dependency, it's gotta be done)

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@Dinnerbone @kjarosh