Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
  • Sep 20 18:49
    pavan-kumar222 edited #799
  • Sep 20 18:48
    pavan-kumar222 opened #799
  • Sep 20 15:48
    rakshit-jain commented #777
  • Sep 19 07:31
    Imagine-DevOps starred pybuilder/pybuilder
  • Sep 17 18:14
    arcivanov commented #774
  • Sep 17 18:13
    arcivanov commented #777
  • Sep 17 07:58
    arcivanov commented #771
  • Sep 17 07:39
    hoxu commented #771
  • Sep 17 04:44
    Coveralls pybuilder/pybuilder (master) -3.7%
  • Sep 17 04:04

    arcivanov on master

    Do not register an unpopulated … Merge pull request #798 from ar… (compare)

  • Sep 17 04:04
    arcivanov closed #798
  • Sep 17 04:04
    arcivanov closed #797
  • Sep 17 04:03
    coveralls commented #798
  • Sep 17 04:00
    coveralls commented #798
  • Sep 17 03:54
    coveralls commented #798
  • Sep 17 03:51
    coveralls commented #798
  • Sep 17 03:46
    coveralls commented #798
  • Sep 17 03:45
    coveralls commented #798
  • Sep 17 03:42
    coveralls commented #798
  • Sep 17 03:36
    coveralls commented #798
Jalaj Patidar
@JalajPatidar
Collecting pandas
  Using cached pandas-1.2.4-cp37-cp37m-manylinux1_x86_64.whl (9.9 MB)
Collecting requests
  Using cached requests-2.25.1-py2.py3-none-any.whl (61 kB)
Collecting tables
  Using cached tables-3.6.1-cp37-cp37m-manylinux1_x86_64.whl (4.3 MB)
Collecting pytz>=2017.3
  Using cached pytz-2021.1-py2.py3-none-any.whl (510 kB)
Collecting python-dateutil>=2.7.3
  Using cached python_dateutil-2.8.1-py2.py3-none-any.whl (227 kB)
Collecting numpy>=1.16.5
  Using cached numpy-1.20.2-cp37-cp37m-manylinux2010_x86_64.whl (15.3 MB)
Collecting chardet<5,>=3.0.2
  Using cached chardet-4.0.0-py2.py3-none-any.whl (178 kB)
Collecting idna<3,>=2.5
  Using cached idna-2.10-py2.py3-none-any.whl (58 kB)
Collecting urllib3<1.27,>=1.21.1
  Using cached urllib3-1.26.4-py2.py3-none-any.whl (153 kB)
Collecting certifi>=2017.4.17
  Using cached certifi-2020.12.5-py2.py3-none-any.whl (147 kB)
Collecting numexpr>=2.6.2
  Using cached numexpr-2.7.3-cp37-cp37m-manylinux2010_x86_64.whl (471 kB)
Collecting six>=1.5
  Using cached six-1.15.0-py2.py3-none-any.whl (10 kB)
Installing collected packages: pytz, six, python-dateutil, numpy, pandas, chardet, idna, urllib3, certifi, requests, numexpr, tables
Successfully installed certifi-2020.12.5 chardet-4.0.0 idna-2.10 numexpr-2.7.3 numpy-1.20.2 pandas-1.2.4 python-dateutil-2.8.1 pytz-2021.1 requests-2.25.1 six-1.15.0 tables-3.6.1 urllib3-1.26.4
WARNING: You are using pip version 20.2.3; however, version 21.0.1 is available.
You should consider upgrading via the '/home/jalaj/Mx.DataScience.Pricing/target/venv/build/cpython-3.7.9.final.0/bin/python3 -m pip install --upgrade pip' command.
Collecting h5py
  Downloading h5py-3.2.1-cp37-cp37m-manylinux1_x86_64.whl (4.1 MB)
Collecting cached-property; python_version < "3.8"
  Using cached cached_property-1.5.2-py2.py3-none-any.whl (7.6 kB)
Requirement already satisfied: numpy>=1.14.5; python_version == "3.7" in ./target/venv/build/cpython-3.7.9.final.0/lib/python3.7/site-packages (from h5py) (1.20.2)
Installing collected packages: cached-property, h5py
Successfully installed cached-property-1.5.2 h5py-3.2.1
WARNING: You are using pip version 20.2.3; however, version 21.0.1 is available.
You should consider upgrading via the '/home/jalaj/Mx.DataScience.Pricing/target/venv/build/cpython-3.7.9.final.0/bin/python3 -m pip install --upgrade pip' command.
Collecting openpyxl
  Using cached openpyxl-3.0.7-py2.py3-none-any.whl (243 kB)
Collecting xlrd
  Using cached xlrd-2.0.1-py2.py3-none-any.whl (96 kB)
Collecting et-xmlfile
  Using cached et_xmlfile-1.0.1.tar.gz (8.4 kB)
Building wheels for collected packages: et-xmlfile
  Building wheel for et-xmlfile (setup.py): started
  Building wheel for et-xmlfile (setup.py): finished with status 'done'
  Created wheel for et-xmlfile: filename=et_xmlfile-1.0.1-py3-none-any.whl size=8917 sha256=68d524030c909c3500b4105742ea6578c23371ad45c8e3db326031871d3ad310
  Stored in directory: /home/jalaj/.cache/pip/wheels/e2/bd/55/048b4fd505716c4c298f42ee02dffd9496bb6d212b266c7f31
Successfully built et-xmlfile
Installing collected packages: et-xmlfile, openpyxl, xlrd
Successfully installed et-xmlfile-1.0.1 openpyxl-3.0.7 xlrd-2.0.1
WARNING: You are using pip version 20.2.3; however, version 21.0.1 is available.
You should consider upgrading via the '/home/jalaj/Mx.DataScience.Pricing/target/venv/build/cpython-3.7.9.final.0/bin/python3 -m pip install --upgrade pip' command.
Arcadiy Ivanov
@arcivanov
image.png
Jalaj Patidar
@JalajPatidar

from pybuilder.core import use_plugin, init

use_plugin("python.core")
use_plugin("python.unittest")
use_plugin("python.flake8")
use_plugin("python.coverage")
use_plugin("python.distutils")


name = "Mx.DataScience.Pricing"
default_task = "publish"


@init
def set_properties(project):
    project.build_depends_on("pandas")
    project.build_depends_on("requests")
    project.build_depends_on("tables")
    project.build_depends_on("h5py")
    project.build_depends_on("openpyxl")
seems like there is some issue in formatting the test reports as xml but that's just a guess
Arcadiy Ivanov
@arcivanov
what about logs?
as in build logs
Jalaj Patidar
@JalajPatidar
sorry , are you referring to these
PyBuilder version 0.12.10
Build started at 2021-04-14 23:40:43
------------------------------------------------------------
[INFO]  Building Mx.DataScience.Pricing version 1.0.dev0
[INFO]  Executing build in /home/jalaj/Mx.DataScience.Pricing
[INFO]  Going to execute task publish
[INFO]  Processing plugin packages 'coverage~=5.2' to be installed with {'upgrade': True}
[INFO]  Processing plugin packages 'flake8~=3.7' to be installed with {'upgrade': True}
[INFO]  Processing plugin packages 'pypandoc~=1.4' to be installed with {'upgrade': True}
[INFO]  Processing plugin packages 'setuptools>=38.6.0' to be installed with {'upgrade': True}
[INFO]  Processing plugin packages 'twine>=1.15.0' to be installed with {'upgrade': True}
[INFO]  Processing plugin packages 'unittest-xml-reporting~=3.0.2' to be installed with {'upgrade': True}
[INFO]  Processing plugin packages 'wheel>=0.34.0' to be installed with {'upgrade': True}
[INFO]  Creating target 'build' VEnv in '/home/jalaj/Mx.DataScience.Pricing/target/venv/build/cpython-3.7.9.final.0'
[INFO]  Creating target 'test' VEnv in '/home/jalaj/Mx.DataScience.Pricing/target/venv/test/cpython-3.7.9.final.0'
[INFO]  Requested coverage for tasks: pybuilder.plugins.python.unittest_plugin:run_unit_tests
[INFO]  Running unit tests
[INFO]  Executing unit tests from Python modules in /home/jalaj/Mx.DataScience.Pricing/src/unittest/python
------------------------------------------------------------
BUILD FAILED - TypeError: 'NoneType' object is not callable (xmlrunner/runner.py:66)
------------------------------------------------------------
Build finished at 2021-04-14 23:40:57
Build took 14 seconds (14375 ms)
Arcadiy Ivanov
@arcivanov
please run with -v -X
and repost
Jalaj Patidar
@JalajPatidar
ok
Arcadiy Ivanov
@arcivanov
did you post the complete build file?
Jalaj Patidar
@JalajPatidar
[DEBUG] Registered Python environment 'system': CPython version 3.7.9.final.0 on linux in ['/home/jalaj/pipeline/bin/python3']
PyBuilder version 0.12.10
Build started at 2021-04-14 23:42:48
------------------------------------------------------------
[DEBUG] Loading project module from ./build.py
[DEBUG] Setting up plugins VEnv at '/home/jalaj/Mx.DataScience.Pricing/.pybuilder/plugins/cpython-3.7.9.final.0'
[DEBUG] Registered Python environment 'pybuilder': CPython version 3.7.9.final.0 on linux in ['/home/jalaj/Mx.DataScience.Pricing/.pybuilder/plugins/cpython-3.7.9.final.0/bin/python3']
[DEBUG] Patched __import__ system to defer plugin loading
[DEBUG] Loading plugin 'python.core'
[DEBUG] Trying to load direct plugin 'python.core', module 'pybuilder.plugins.python.core_plugin'
[DEBUG] Found direct plugin 'python.core', module 'pybuilder.plugins.python.core_plugin'
[DEBUG] Loading plugin 'python.unittest'
[DEBUG] Trying to load direct plugin 'python.unittest', module 'pybuilder.plugins.python.unittest_plugin'
[DEBUG] Found direct plugin 'python.unittest', module 'pybuilder.plugins.python.unittest_plugin'
[DEBUG] Loading plugin 'python.flake8'
[DEBUG] Trying to load direct plugin 'python.flake8', module 'pybuilder.plugins.python.flake8_plugin'
[DEBUG] Found direct plugin 'python.flake8', module 'pybuilder.plugins.python.flake8_plugin'
[DEBUG] Loading plugin 'python.coverage'
[DEBUG] Trying to load direct plugin 'python.coverage', module 'pybuilder.plugins.python.coverage_plugin'
[DEBUG] Found direct plugin 'python.coverage', module 'pybuilder.plugins.python.coverage_plugin'
[DEBUG] Loading plugin 'python.distutils'
[DEBUG] Trying to load direct plugin 'python.distutils', module 'pybuilder.plugins.python.distutils_plugin'
[DEBUG] Found direct plugin 'python.distutils', module 'pybuilder.plugins.python.distutils_plugin'
[DEBUG] Loading plugin 'core'
[DEBUG] Trying to load direct plugin 'core', module 'pybuilder.plugins.core_plugin'
[DEBUG] Found direct plugin 'core', module 'pybuilder.plugins.core_plugin'
[DEBUG] Loading plugin 'analysis'
[DEBUG] Trying to load direct plugin 'analysis', module 'pybuilder.plugins.analysis_plugin'
[DEBUG] Found direct plugin 'analysis', module 'pybuilder.plugins.analysis_plugin'
[DEBUG] Found task 'clean' with dependencies []
[DEBUG] Registering task 'clean'
[DEBUG] Found task 'compile_sources' with dependencies [prepare]
[DEBUG] Registering task 'compile_sources'
[DEBUG] Registering initializer 'init'
[DEBUG] Found task 'install' with dependencies [package, publish(optional)]
[DEBUG] Registering task 'install'
[DEBUG] Found task 'package' with dependencies [compile_sources, run_unit_tests(optional)]
[DEBUG] Registering task 'package'
[DEBUG] Found task 'prepare' with dependencies []
[DEBUG] Registering task 'prepare'
[DEBUG] Found task 'print_module_path' with dependencies []
[DEBUG] Registering task 'print_module_path'
[DEBUG] Found task 'print_scripts_path' with dependencies []
[DEBUG] Registering task 'print_scripts_path'
[DEBUG] Found task 'publish' with dependencies [package, verify(optional)]
[DEBUG] Registering task 'publish'
[DEBUG] Found task 'run_integration_tests' with dependencies [package]
[DEBUG] Registering task 'run_integration_tests'
[DEBUG] Found task 'run_unit_tests' with dependencies [compile_sources]
[DEBUG] Registering task 'run_unit_tests'
[DEBUG] Found task 'verify' with dependencies [run_integration_tests(optional)]
[DEBUG] Registering task 'verify'
[DEBUG] Found task 'prepare' with dependencies []
[DEBUG] Registering task 'prepare'
[DEBUG] Registering initializer 'init_python_directories'
[DEBUG] Found task 'package' with dependencies []
[DEBUG] Registering task 'package'
[DEBUG] Found action coverage_init
[DEBUG] Registering action 'coverage_init'
[DEBUG] Registering initializer 'init_test_source_directory'
[DEBUG] Found task 'run_unit_tests' with dependencies []
[DEBUG] Registering task 'run_unit_tests'
[DEBUG] Found task 'analyze' with dependencies [prepare]
[DEBUG] Registering task 'analyze'
[DEBUG] Found action assert_flake8_is_executable
[DEBUG] Regist
the logs posted above are from the build using the build.py file I posted above
Arcadiy Ivanov
@arcivanov
they got cut
Jalaj Patidar
@JalajPatidar
ah yeah sec
how do I post the entire thing
Arcadiy Ivanov
@arcivanov
just keep posting from the place it was cut
or post the file
Jalaj Patidar
@JalajPatidar
ok
Arcadiy Ivanov
@arcivanov
do you actually have tests there?
do me a favor
please run with pyb -Premote_debug=True -v -X
there is going to be TONS of logs
Jalaj Patidar
@JalajPatidar
I do have two tests
the build was running successfully, the modules they were testing have been unaltered since the last successful build
and I'll post the TON of logs shortly, gimme a sec
Arcadiy Ivanov
@arcivanov
thanks
:)
so if everything ran, then what changed?
Traceback (most recent call last):
  File "/home/jalaj/pipeline/lib/python3.7/site-packages/pybuilder/cli.py", line 476, in main
    environments=options.environments, tasks=arguments)
  File "/home/jalaj/pipeline/lib/python3.7/site-packages/pybuilder/reactor.py", line 240, in build
    execution_summary = self.build_execution_plan(tasks, execution_plan)
  File "/home/jalaj/pipeline/lib/python3.7/site-packages/pybuilder/reactor.py", line 279, in build_execution_plan
    reactor=self)
  File "/home/jalaj/pipeline/lib/python3.7/site-packages/pybuilder/execution.py", line 399, in execute_execution_plan
    summaries.append(self.execute_task(task, **kwargs))
  File "/home/jalaj/pipeline/lib/python3.7/site-packages/pybuilder/execution.py", line 346, in execute_task
    task.execute(self.logger, kwargs, _executable=_executable)
  File "/home/jalaj/pipeline/lib/python3.7/site-packages/pybuilder/execution.py", line 185, in execute
    executable.execute(argument_dict)
  File "/home/jalaj/pipeline/lib/python3.7/site-packages/pybuilder/execution.py", line 101, in execute
    self.callable(*arguments)
  File "/home/jalaj/pipeline/lib/python3.7/site-packages/pybuilder/plugins/python/unittest_plugin.py", line 71, in run_unit_tests
    run_tests(project, logger, reactor, "unittest", "unit tests")
  File "/home/jalaj/pipeline/lib/python3.7/site-packages/pybuilder/plugins/python/unittest_plugin.py", line 100, in run_tests
    project.get_property("remote_debug"))
  File "/home/jalaj/pipeline/lib/python3.7/site-packages/pybuilder/plugins/python/unittest_plugin.py", line 151, in execute_tests_matching
    result = runner.run(tests)
  File "/home/jalaj/Mx.DataScience.Pricing/.pybuilder/plugins/cpython-3.7.9.final.0/lib/python3.7/site-packages/xmlrunner/runner.py", line 66, in run
    test(result)
this makes little sense
Jalaj Patidar
@JalajPatidar
just added two new functions to the src/main/python/downloders.py file
Arcadiy Ivanov
@arcivanov
the test in question is null?
Jalaj Patidar
@JalajPatidar
yeah looks confusing, let me post the full logs file
Arcadiy Ivanov
@arcivanov
thanks!
Jalaj Patidar
@JalajPatidar
the two test cases that were there earlier when the build was running successfully are un-altered.
let me comment out the new code added in the main/python folder and see what happens
Arcadiy Ivanov
@arcivanov
sorry, I messed up with the logs :)
it's pyb -Premote_debug=2 -v -X
Jalaj Patidar
@JalajPatidar
no worries. I actually commented out the new code and the build passed. But it's still confusing as no new test cases were added after adding the new code.
Arcadiy Ivanov
@arcivanov
yeah, but new test cases might be failing in unexpected ways or more likely the modules fail to load
with those new methods
if you run the above
and post the logs
there may be megabytes
thanks!
Jalaj Patidar
@JalajPatidar
yea sec
Arcadiy Ivanov
@arcivanov
no rush