[testsuite] Bug: excluding 2.1 also excludes 2.11 and 2.10

#1

Hi all,

I've just been trying to get autobahn to run as many test cases as possible against
em-websocket (previously I had to entirely disable the 2.* tests).

I've since modified my configuration of the test runner to be the following:

  {
    "options": {"version": 10},
     "servers": [
                 {"agent": "EMWebSocket", "url": "ws://localhost:8080"},
                 {"agent": "AutobahnServer", "url": "ws://localhost:9000"}
                 ],
     "cases": ["*"],
     "exclude-cases": [],
     "exclude-agent-cases": {"EMWebSocket": ["2.1", "2.3", "2.4", "2.5", "2.6"]}
  }

However, it seems for that this configuration doesn't just exclude "2.1" also
excludes "2.10" and "2.11".

I'm not sure if this is intentional or not, but doesn't help when trying to exclude
certain tests that cause em-websocket to die completely.

Regards,
Micheil Smith

···

--
Pusher.com

0 Likes

#2

thanks for reporting .. bug (fixed now on master):

https://github.com/oberstet/Autobahn/issues/71

···

2011/10/31 Micheil Smith <mic...@brandedcode.com>:

Hi all,

I've just been trying to get autobahn to run as many test cases as possible against
em-websocket (previously I had to entirely disable the 2.* tests).

I've since modified my configuration of the test runner to be the following:

   \{
     &quot;options&quot;: \{&quot;version&quot;: 10\},
      &quot;servers&quot;: \[
                  \{&quot;agent&quot;: &quot;EMWebSocket&quot;, &quot;url&quot;: &quot;ws://localhost:8080&quot;\},
                  \{&quot;agent&quot;: &quot;AutobahnServer&quot;, &quot;url&quot;: &quot;ws://localhost:9000&quot;\}
                  \],
      &quot;cases&quot;: \[&quot;\*&quot;\],
      &quot;exclude\-cases&quot;: \[\],
      &quot;exclude\-agent\-cases&quot;: \{&quot;EMWebSocket&quot;: \[&quot;2\.1&quot;, &quot;2\.3&quot;, &quot;2\.4&quot;, &quot;2\.5&quot;, &quot;2\.6&quot;\]\}
   \}

However, it seems for that this configuration doesn't just exclude "2.1" also
excludes "2.10" and "2.11".

I'm not sure if this is intentional or not, but doesn't help when trying to exclude
certain tests that cause em-websocket to die completely.

Regards,
Micheil Smith
--
Pusher.com

0 Likes