pantsbuild.pants.contrib.python.checks 1.10.0rc2

Additional python lints and checks.

Pants is an Apache2 licensed build tool written in Python.

The latest documentation can be found here.

1.10.x Stable Releases

This document describes releases leading up to the 1.10.x stable series.

1.10.0rc2 (10/30/2018)

Bugfixes

• Pin jupyter transitive deps in integration tests (#6568) Pex Issue #561, Pants PR #6568 Pex PR #562

• More pinning to fix jupyter floats. (#6600) PR #6600

• Move ivy/coursier link farms under versioned task directories (#6686) PR #6686

• Pause all PantsService threads before forking a pantsd-runner (#6671) PR #6671

Refactoring, Improvements, and Tooling

• Fatal error logging followup fixes (#6610) PR #6610

• first attempt at centralizing more global error logging state in ExceptionSink (#6552) PR #6552

• pantsd client logs exceptions from server processes (#6539) PR #6539

• create singleton ExceptionSink object to centralize logging of fatal errors (#6533) PR #6533

• Switch synchronization primitive usage to parking_lot (#6564) PR #6564

• Fix bugs in the parent/child relationship in ProcessManager (#6670) PR #6670

• Remove the FSEventService pool in favor of execution on the dedicated service thread. (#6667) PR #6667

• Make PailgunServer multithreaded in order to avoid blocking the PailgunService thread. (#6669) PR #6669

1.10.0rc1 (09/17/2018)

Bugfixes

• Fix encoding of workunits under pantsd (#6505) PR #6505

Documentation

• Fix formatting in notes (#6482) PR #6482

1.10.0rc0 (09/10/2018)

New features

• Allow process_executor to make a JDK present (#6443) PR #6443

• Zinc compiles can execute hermetically (#6351) PR #6351

• Add a node-install goal to Pants for installing node_modules (#6367) PR #6367

Bugfixes

• Fixup JsonEncoderTest encoding tests. (#6457) PR #6457

• Switch back to forked grpc-rs (#6418) PR #6418

• Fix pants_requirement environment markers. (#6451) PR #6451

• Fix CI failures introduced by #6275 (#6454) PR #6454

• Make sure directory digest is defined for cache hits (#6442) PR #6442

• Cancel running work when entering the fork context (#6464) PR #6464

• Fix setup.py rendering. (#6439) PR #6439

• Detect ns packages using correct interpreter. (#6428) PR #6428

• Fixup tests involving pexrc. (#6446) PR #6446

• [fix] Pass full path to isdir rather than just basename. (#6453) PR #6453

• Add missing call to super. (#6477) PR #6477

• Remove broken pyenv shims from the PATH. (#6469) PR #6469

Refactoring, Improvements, and Tooling

• fs_util and process_executor: Use default –local-store-path (#6444) PR #6444

• satisfy python_dist setup_requires with a pex to resolve transitive deps, and some other unrelated native toolchain changes (#6275) PR #6275

• Work around production coverage float. (#6452) PR #6452

• Get clippy from the beta channel. (#6441) PR #6441

• Tighten travis matrix and python activation. (#6440) Issue #8315 PR #6440

• Ensure unstable pants dists can never conflict. (#6460) PR #6460

• Extend fs_util deadline to 30 minutes (#6471) PR #6471 PR #6433

• remove clean-all from pants invocations in python_dist() integration testing + some other refactoring (#6474) PR #6474

• Re-enable pants_setup_requires:bin IT. (#6466) PR #6466

Documentation

• Minor tweak on blogpost (#6438) PR #6438

1.10.0.dev5 (08/31/2018)

New features

• Support HEAD redirects in RESTfulArtifactCache. (#6412) PR #6412

• Add json upload summary to fs_util (#6318) (#6389) PR #6318

• Override interpreter constraints if global option is passed down (#6387) PR #6387 PR #6250

Bugfixes

• Fix –binaries-path-by-id fingerprinting error (#6413) PR #6413

• Remove false positive glob expansion failure warnings (#6278) PR #6278

• Change zinc logging so it doesn’t error out (#6409) PR #6409

• Move fork context management to rust (#5521) PR #5521

• Link requirements targets to their source. (#6405) PR #6405

• Fix pants_requirement by allowing Python 3 (#6391) PR #6391

Refactoring, Improvements, and Tooling

• Fix clippy errors (#6420) PR #6420

• Re-enable rust clippy on its own shard (#6419) PR #6419

• Set JDK properties for remote execution (#6417) PR #6417 PR #391

• s/size/size_bytes/ for consistency (#6410) PR #6410

• Update rust deps (#6399) PR #6399

• Update scalafmt to 1.5.1 (#6403) PR #6403

Migration to Python3 compatibility

• Python 3 - fixes to get most of src unit tests green (#6372) PR #6372

Documentation

• Clarify release docs for stable branches. (#6427) PR #6427

• Coursier Migration Blogpost (#6400) PR #6400

• add 1.9.0rc2 notes (#6425) PR #6425

1.10.0.dev4 (08/24/2018)

Refactoring, Improvements, and Tooling

• Fix CI (#6402) PR #6402

• Requirements on language-specific sources should be optional. (#6375) PR #6375

• Deprecate –quiet recursive option (#6156) PR #6156

• Decode python_eval template resource as utf-8. (#6379) PR #6379

• Use set literals & set comprehensions where possible (#6376) PR #6376

• Stabilize test case sorting in suites. (#6371) PR #6371

Migration to Python3 compatibility

• No longer expect failure from test_pinger (#6373) PR #6373

• Pin interpreter <3.7 in ci. (#6364) PR #6364

Documentation

• [engine] Add note to readme about fs_util (#6377) PR #6377

1.10.0.dev3 (08/20/2018)

New features

• Add contrib dist support to pants_requirement. (#6365) PR #6365

• Allow pex download path to be overridden (#6348) PR #6348

Bugfixes

• Fix Single Address Exclude (#6366) PR #6366

• Add an environment marker to pants_requirement. (#6361) PR #6361

• Make requirements on codegen products optional. (#6357) PR #6357

• Use –entry-point not -c when building pex (#6349) PR #6349 PR #6267

• Recover from cancelled remote execution RPCs (#6188) PR #6188

• Use forked version of grpcio (#6344) PR #6344 PR #211

• added fullpath to fix path concat issue with files when not in git root (#6331) PR #6331

• Log test targets that failed to run. (#6335) PR #6335

Refactoring, Improvements, and Tooling

• Run clippy with nightly rust on CI (#6347) PR #6347

• Fix formatting of store.rs (#6350) PR #6350 PR #6336

• Download Directory recursively from remote CAS (#6336) PR #6336

• Process execution: Create symlink to JDK on demand (#6346) PR #6346

• Simplify ExecuteProcessRequest construction (#6345) PR #6345

• ci.sh uses positive rather than negative flags (#6342) PR #6342

• Merge directories with identical files (#6343) PR #6343

• Set chunk size in process_executor (#6337) PR #6337

Migration to Python3 compatibility

• Python 3 - fixes to get backend mostly green (#6360) PR #6360

• Python 3 - fixes to get green contrib (#6340) PR #6340

1.10.0.dev2 (08/10/2018)

New features

• Add a –loop flag, to allow for running continuously (#6270) PR #6270

Bugfixes

• pantsrc file paths are always unicode (#6316) PR #6316

Refactoring, Improvements, and Tooling

• Relativize most paths in the zinc compile command line (#6322) PR #6322

• A few misc cleanups (#6324) PR #6324

• Use dependency ClasspathEntries, not merged strings (#6317) PR #6317

• Register products when compilation finishes (#6315) PR #6315

• ClasspathEntry optionally takes a DirectoryDigest (#6297) PR #6297

• Cache more of rust. (#6309) PR #6309

• Tighten up local process streaming. (#6307) PR #6307

• Bump rust to 1.28 (#6306) PR #6306

• Remove unused Task._build_invalidator root param. (#6308) PR #6308

• Reinstate possibility of local process streaming. (#6300) PR #6300

Documentation Updates

• Document Pants features for Organizations (#5673) PR #5673

• Add Sigma to “Powered by Pants” page (#6314) PR #6314

• Add contributor (#6312) PR #6312

Migration to Python3 compatibility

• Skip known to fail tests in py3 (#6323) PR #6323

• Strings are correctly returned from rust code (#6325) PR #6325

• Switch to Py2 and Py3 shards. (#6289) PR #6289

• Python 3 fixes - various bytes vs unicode issues (#6311) PR #6311

• Always return unicode with hexdigest() (#6313) PR #6313

• Specify unicode vs bytes for Path and FileContent types (#6303) PR #6303

• Python 3 fixes - add open backport to contrib (#6295) PR #6295

• Python 3 fixes - add open() backport to safe_open() (#6304) PR #6304 PR #6290

• Require the system encoding to be UTF-8 (#6305) PR #6305

• Python 3 fixes - add open() backport stage 2 (#6291) PR #6291 PR #6290

• drop self from __init__ and __new__ (#6299) PR #6299

1.10.0.dev1 (08/03/2018)

New features

• Add –output-dir flag to ScalaFmt task (#6134) PR #6134

Bugfixes

• Fix a deadlock in local process execution. (#6292) PR #6292

• When python target compatibility is not set, use interpreter constraints. (#6284) PR #6284

• Bound pytest below 3.7 to avoid a ZipImportError (#6285) PR #6285

Refactoring, Improvements, and Tooling

• Kill WrappedPEX. (#6280) PR #6280

• Add copy() method to datatype (#6269) PR #6269

• Upgrade to pex 1.4.5. (#6267) PR #6267

• Hard link or copy ivy and coursier cache (#6246) PR #6246

Documentation Updates

• Modify the alias page to actually reference the alias target (#6277) PR #6277

Migration to Python3 compatibility

• Python 3 fixes - add open() backport stage 1 (#6290) PR #6290

• Python 3 fixes - fix issues with binaries, option, pantsd, java, and build graph (#6287) PR #6287

• Python 3 fixes - fix issues with engine (#6279) PR #6279

• Rename deprecated assertions (#6286) PR #6286

• Python 3 fixes - fix contrib folders problems (#6272) PR #6272

• Python 3 fixes - fix contrib/python checkstyle (#6274) PR #6274

1.10.0.dev0 (07/27/2018)

• Remove 1.10.x deprecations (#6268) PR #6268

New Features

• Add a debug dump flag to the zinc analysis extractor. (#6241) PR #6241

• Add functionality to create jars in zinc wrapper (#6094) PR #6094

• Allow user to specify chunk size (#6173) PR #6173

Bugfixes

• Fix spurious deprecation warning for fatal_warnings (#6237) PR #6237

• Associate cli arguments with executables and refactor llvm/gcc c/c++ toolchain selection (#6217) PR #6217

• Fix pydist native sources selection (#6205) PR #6205

Refactoring, Improvements, and Tooling

• Convert fmt.isort to bootstrapping isort. (#6182) PR #6182

• Fix env construction on ExecuteProcessRequest (#6220) PR #6220

• Ci deduplication (#6186) PR #6186

• [missing-deps-suggest] move buildozer cli to a new line (#6190) PR #6190

• Print stack trace on ExecutionGraph task failures (#6177) PR #6177

• Add basic native task unit tests. (#6179) PR #6179

• Start migrating away from SchedulerTestBase (#5929) PR #5929

• Only clone taken Strings, not all Strings (#6240) PR #6240

• Remove unused custom working_set parameters. (#6221) PR #6221

• Update protobuf and grpcio deps (#6248) PR #6248

Migration to Python3 compatibility

• Python 3 fixes - fix backend/docgen test issues with bytes vs unicode (#6265) PR #6265

• Python 3 fixes - fix scm bytes vs unicode issues (#6257) PR #6257

• Python 3 fixes - fix net/http issues with bytes vs unicode (#6258) PR #6258

• Python 3 fixes - fix test_base.create_files() unicode issue (#6266) PR #6266

• Fix invalidation unicode vs bytes issues (#6262) PR #6262

• Fix fake options unicode vs bytes issues (#6263) PR #6263

• Python 3 fixes - fix ivy issues with unicode vs bytes (#6264) PR #6264

• Bump beautifulsoup4 to 4.6 to fix Python 3 issue. (#6260) PR #6260

• Python 3 fixes - fix unicode and __hash__ issues with release folder (#6261) PR #6261

• Python 3 fixes - fix syntax issue in reporting test (#6259) PR #6259

• Python 3 fixes - fix process test byte issue (#6256) PR #6256

• Split file set by line instead of spaces to resolve errors (#6247) PR #6247

• Python 3 fixes - test root unicode vs bytes (#6253) PR #6253

• Port test/tasks to Python 3 (#6255) PR #6255

• Python 3 fixes - fix base folder (#6252) PR #6252

• Python 3 fixes - fix invalid ABCMeta comparison (#6251) PR #6251

• Fix syntax issue with raising error (#6245) PR #6245

• Exclude faulthandler and futures if Python 3 (#6244) PR #6244

• Python 3 fixes - fix tarutil and contextutil_test (#6243) PR #6243

• Python 3 fixes - use unicode with temporary_directory() file path (#6233) PR #6233

• Python 3 fixes - fix netrc.py, retry.py, and test_objects.py (#6235) PR #6235

• Python 3 fixes - fix dirutil, fileutil, and xml_parser tests (#6229) PR #6229 PR #6228

• Fix issue of os.environ expecting bytes vs unicode in Py2 vs Py3 (#6222) PR #6222

• Python 3 fixes - specify binary vs unicode behavior of temporary_file() (#6226) PR #6226

• Python 3 fixes - fix process_handler timing out (#6232) PR #6232

• Port bin to Python 3 (#6126) PR #6126

• Python 3 fixes - fix various TestBase issues (#6228) PR #6228

• An initial engine terminal UI and demo. (#6223) PR #6223

• Python 3 - fix cffi resolver issues (#6225) PR #6225

• Exclude subprocess32 if Python 3 (#6212) PR #6212

• Fix imports of future.utils (#6213) PR #6213

• Port test’s root folder (#6207) PR #6207

• Port task (#6200) PR #6200

• Port backend/jvm (#6092) PR #6092

• Port net (#6162) PR #6162

• Port pantsd/ to python3 (#6136) PR #6136

• futurize confluence (#6115) PR #6115

• Port testutils to Python 3 (#6211) PR #6211

• Port examples to Python 3 (#6210) PR #6210

• Port pants-plugins to Python 3 (#6209) PR #6209

• Port cache to Python 3 (#6129) PR #6129

• Port stats to Python 3 (#6198) PR #6198

• Port subsystem to Python 3 (#6199) PR #6199

• Port source to Python 3 (#6197) PR #6197

• Port scm to Python 3 (#6196) PR #6196

• Port releases to Python 3 (#6194) PR #6194

• Port process package to Python 3 (#6193) PR #6193

• Prepare a noop release for 1.9.0rc1. (#6204) PR #6204

• Port reporting to Python 3 (#6195) PR #6195

• Port build graph to Python 3 (#6128) PR #6128

• Port contrib/node to py3 (#6158) PR #6158

• update contrib/python with py3 compat (#6184) PR #6184