Call for testsuite running results

All ESP8266 boards running MicroPython.
Official boards are the Adafruit Huzzah and Feather boards.
Target audience: MicroPython users with an ESP8266 board.
pfalcon
Posts: 1155
Joined: Fri Feb 28, 2014 2:05 pm

Call for testsuite running results

Post by pfalcon » Fri Apr 01, 2016 10:54 pm

We've approached an important milestone in ESP8266 port development: a moment when MicroPython testsuite passes successfully. Well, it passes for me, and I would like to collect as wide results as possible. The sooner lots of results will be collected, the sooner we'll reach final frontier of the phase 1 of the development: increased heap size.

Instructions:

1. Make sure you followed background requirements in http://forum.micropython.org/viewtopic.php?f=16&t=1689

2. esptool.py erase_flash

3. make deploy

4.

Code: Select all

cd ../tests
./run-tests --target esp8266 --device /dev/ttyUSB0
Awesome MicroPython list
Pycopy - A better MicroPython https://github.com/pfalcon/micropython
MicroPython standard library for all ports and forks - https://github.com/pfalcon/micropython-lib
More up to date docs - http://pycopy.readthedocs.io/

slzatz
Posts: 92
Joined: Mon Feb 09, 2015 1:09 am

Re: [URGENT] Call for testsuite running results

Post by slzatz » Sat Apr 02, 2016 3:20 am

Adafruit Feather Huzzah esp8266. Looks good.

Code: Select all

405 tests performed (13213 individual testcases)
405 tests passed
48 tests skipped: builtin_compile class_descriptor exception_chain fun_name ordereddict1 parser slice_attrs string_splitlines machine1 machine_mem urandom_extra vfs_fat_ramdisk bytearray_construct bytes_construct cmath_fun cmath_fun_special complex1 float2int float2int_doubleprec float_divmod int_big_float math_fun_special string_format true_value types meminfo memstats native_closure native_const native_misc viper_addr viper_args viper_binop_arith viper_binop_comp viper_binop_comp_imm viper_binop_multi_comp viper_cond viper_error viper_misc viper_ptr16_load viper_ptr16_store viper_ptr32_load viper_ptr32_store viper_ptr8_load viper_ptr8_store viper_subscr rge_sm sys_exc_info
slzatz@slzatz-ThinkPad-X200:~/micropython/tests$ 

numero_trey
Posts: 2
Joined: Fri Apr 01, 2016 11:31 pm

Re: [URGENT] Call for testsuite running results

Post by numero_trey » Sat Apr 02, 2016 5:59 am

Ran it on a $9 NodeMCU knockoff and it passes for me. Have run the suite about a dozen times.

vfl68
Posts: 4
Joined: Sun Feb 28, 2016 9:54 am

Re: [URGENT] Call for testsuite running results

Post by vfl68 » Sat Apr 02, 2016 7:03 am

On the Olimex MOD-WIFI-ESP8266-DEV it seems ok too :

Code: Select all

405 tests performed (13213 individual testcases)
405 tests passed
48 tests skipped: builtin_compile class_descriptor exception_chain fun_name ordereddict1 parser slice_attrs string_splitlines machine1 machine_mem urandom_extra vfs_fat_ramdisk bytearray_construct bytes_construct cmath_fun cmath_fun_special complex1 float2int float2int_doubleprec float_divmod int_big_float math_fun_special string_format true_value types meminfo memstats native_closure native_const native_misc viper_addr viper_args viper_binop_arith viper_binop_comp viper_binop_comp_imm viper_binop_multi_comp viper_cond viper_error viper_misc viper_ptr16_load viper_ptr16_store viper_ptr32_load viper_ptr32_store viper_ptr8_load viper_ptr8_store viper_subscr rge_sm sys_exc_info

pfalcon
Posts: 1155
Joined: Fri Feb 28, 2014 2:05 pm

Re: [URGENT] Call for testsuite running results

Post by pfalcon » Sat Apr 02, 2016 8:10 am

Thanks for quick response guys! Looking for more reports...
Awesome MicroPython list
Pycopy - A better MicroPython https://github.com/pfalcon/micropython
MicroPython standard library for all ports and forks - https://github.com/pfalcon/micropython-lib
More up to date docs - http://pycopy.readthedocs.io/

mianos
Posts: 84
Joined: Sat Aug 22, 2015 6:42 am

Re: [URGENT] Call for testsuite running results

Post by mianos » Sat Apr 02, 2016 8:30 am

NodeMCU from aliexpress:
405 tests performed (13213 individual testcases)
405 tests passed

WEMOS D1:
405 tests performed (13213 individual testcases)
405 tests passed

Itead studio 'sonoff' ESP with a PSU and relay on board.
405 tests performed (13213 individual testcases)
405 tests passed

An original ESP01 (Flash id 1340C8, I think this one was a 1MBit flash or maybe even a 512K, it's old)
405 tests performed (13213 individual testcases)
405 tests passed

(It might be useful to capture the flash id with esp.flash_id() too. Being such an integrated part, that's the only real difference).

gschmott
Posts: 6
Joined: Sun Mar 13, 2016 5:03 pm

Re: [URGENT] Call for testsuite running results

Post by gschmott » Sat Apr 02, 2016 12:51 pm

Passed on a generic ESP-12 module soldered onto a board:

405 tests performed (13213 individual testcases)
405 tests passed

Of course trying to connect to my access point fails unless I drop my heap-size down to 11KB. Is this issue (RAM) going to be addressed next? Kind limited having an ESP8266 that can't connect to the Internet ;-)

wendlers
Posts: 47
Joined: Wed Mar 16, 2016 10:07 pm

Re: [URGENT] Call for testsuite running results

Post by wendlers » Sat Apr 02, 2016 7:08 pm

Tests pass on Geekcreit NodeMcu (ESP-12E, e. g. http://www.banggood.com/Geekcreit-Doit- ... 85891.html)

Code: Select all

405 tests performed (13213 individual testcases)
405 tests passed
48 tests skipped: builtin_compile class_descriptor exception_chain fun_name ordereddict1 parser slice_attrs string_splitlines machine1 machine_mem urandom_extra vfs_fat_ramdisk bytearray_construct bytes_construct cmath_fun cmath_fun_special complex1 float2int float2int_doubleprec float_divmod int_big_float math_fun_special string_format true_value types meminfo memstats native_closure native_const native_misc viper_addr viper_args viper_binop_arith viper_binop_comp viper_binop_comp_imm viper_binop_multi_comp viper_cond viper_error viper_misc viper_ptr16_load viper_ptr16_store viper_ptr32_load viper_ptr32_store viper_ptr8_load viper_ptr8_store viper_subscr rge_sm sys_exc_info
Last edited by wendlers on Sat Apr 02, 2016 7:13 pm, edited 1 time in total.

wendlers
Posts: 47
Joined: Wed Mar 16, 2016 10:07 pm

Re: [URGENT] Call for testsuite running results

Post by wendlers » Sat Apr 02, 2016 7:13 pm

Tests pass on LoLin V3 NodeMcu (ESP-12E, e. g. http://www.banggood.com/V3-NodeMcu-Lua- ... 92733.html)

Code: Select all

405 tests performed (13213 individual testcases)
405 tests passed
48 tests skipped: builtin_compile class_descriptor exception_chain fun_name ordereddict1 parser slice_attrs string_splitlines machine1 machine_mem urandom_extra vfs_fat_ramdisk bytearray_construct bytes_construct cmath_fun cmath_fun_special complex1 float2int float2int_doubleprec float_divmod int_big_float math_fun_special string_format true_value types meminfo memstats native_closure native_const native_misc viper_addr viper_args viper_binop_arith viper_binop_comp viper_binop_comp_imm viper_binop_multi_comp viper_cond viper_error viper_misc viper_ptr16_load viper_ptr16_store viper_ptr32_load viper_ptr32_store viper_ptr8_load viper_ptr8_store viper_subscr rge_sm sys_exc_info

User avatar
deshipu
Posts: 1347
Joined: Thu May 28, 2015 5:54 pm

Re: [URGENT] Call for testsuite running results

Post by deshipu » Sat Apr 02, 2016 7:57 pm

I ran the tests on Adafruit Huzzah Feather. Initially, I forgot to apply the patch, and had two tests fail:

Code: Select all

FAIL  basics/struct1.py
FAIL  misc/features.py
But they didn't output any debugging information or anything. Then I tried again with the patch, and all tests passed.
Then I tried with an ESP-01 module, and got one failure:

Code: Select all

FAIL  basics/int_big_lshift.py
I reset the module and tried again, and this time all tests passed. I blame serial communication errors.

Post Reply