Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merge for new release #557

Merged
merged 225 commits into from
Dec 11, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
225 commits
Select commit Hold shift + click to select a range
f561152
Merge branch 'master' of https://github.com/eqcorrscan/EQcorrscan int…
calum-chamberlain Aug 9, 2022
67ef692
Update changes for 0.4.4 released
calum-chamberlain Aug 9, 2022
03176ea
make distance_index long; otherwise segfault on more than 46341 detec…
flixha Dec 9, 2022
6ee0d96
add changelog entry
flixha Dec 9, 2022
5f1030b
compute median for cccsum in parallel
flixha Dec 12, 2022
9ad9fb0
add changelog entry
flixha Dec 12, 2022
df876c2
add check for when cores is None or 0
flixha Dec 12, 2022
0794923
Merge pull request #523 from flixha/fix_distance_decluster_int32_limit
calum-chamberlain Dec 22, 2022
3b29264
Bump obspy version for NCEDC tests
calum-chamberlain Dec 22, 2022
79b9208
bump obspy version in test env
calum-chamberlain Dec 22, 2022
8ccaeb7
Merge pull request #532 from eqcorrscan/obspy_1.4_test_env
calum-chamberlain Dec 22, 2022
a03bc05
Merge branch 'develop' of https://github.com/eqcorrscan/EQcorrscan in…
calum-chamberlain Dec 22, 2022
ff2555a
Update test_conda_env.yml (#533)
calum-chamberlain Jan 1, 2023
97291ac
Merge branch 'develop' of https://github.com/eqcorrscan/EQcorrscan in…
calum-chamberlain Jan 1, 2023
e681c67
Use different stacking methods for subspace multiplex (#534)
calum-chamberlain Jan 1, 2023
9b976eb
Merge branch 'develop' of https://github.com/eqcorrscan/EQcorrscan in…
calum-chamberlain Jan 1, 2023
d5ab109
Merge branch 'develop' into speedup_07_MAD_parallel
calum-chamberlain Jan 1, 2023
3085ab6
Use ThreadPool for 5x speedup and no extra deps.
calum-chamberlain Jan 1, 2023
98ae9ef
Stickler
calum-chamberlain Jan 1, 2023
0a0af44
Bugfix: Consistent trace slicing length for catalog_to_dd._prepare_st…
flixha Jan 1, 2023
0b57a44
Merge branch 'develop' into speedup_07_MAD_parallel
calum-chamberlain Jan 1, 2023
0545f5e
Speedup 06: 30x speedup for _group_detect - handling detections (#528)
flixha Jan 1, 2023
818e293
Speedup 04: quick trace selection (#526)
flixha Jan 1, 2023
4605393
Merge branch 'develop' into speedup_07_MAD_parallel
calum-chamberlain Jan 1, 2023
705ec4e
Merge branch 'develop' of https://github.com/eqcorrscan/EQcorrscan in…
calum-chamberlain Jan 1, 2023
b2ecb31
Merge pull request #531 from flixha/speedup_07_MAD_parallel
flixha Jan 3, 2023
9dafb40
Speedup 01 Quicker grouping of templates (#524)
flixha Jan 3, 2023
8e5ca9d
Speedup 05: Retrieve unique detections in family and in `matched_filt…
flixha Jan 3, 2023
0fc5ec7
Speedup 02: 3x speed up for prep_data_for_correlation with custom cop…
flixha Jan 3, 2023
3a17a34
More flexible selection of vertical and horizontal channels (#505)
flixha Jan 4, 2023
38788a4
Merge branch 'develop' of https://github.com/eqcorrscan/EQcorrscan in…
calum-chamberlain Jan 4, 2023
ebb6a81
speed up _get_array_dicts with direct access to UTCDateTime.__dict__[…
flixha Jan 5, 2023
13e696f
speed up trace preparation with direct access to stream.traces with i…
flixha Jan 9, 2023
a38ab89
add changelog entry
flixha Jan 9, 2023
25f8392
fix issue in setting endtime manually (had no effect on results)
flixha Jan 10, 2023
41d4adc
fix issue in setting endtime manually (had no effect on results)
flixha Jan 10, 2023
81c21c7
Allow option to weight correlation in catalog_to_dd by raw correlatio…
calum-chamberlain Mar 16, 2023
2adabad
Merge branch 'develop' into speedup_10_get_array_dicts
calum-chamberlain Mar 16, 2023
d1afd5f
Use np.copy instead of deepcopy
calum-chamberlain Mar 16, 2023
b738b8e
Merge branch 'develop' of https://github.com/eqcorrscan/EQcorrscan in…
calum-chamberlain Mar 16, 2023
cdde8c9
Merge pull request #536 from flixha/speedup_10_get_array_dicts
calum-chamberlain Mar 16, 2023
b1593a8
WIP: Better multi core (#337)
calum-chamberlain Mar 16, 2023
82b4c9e
Speedup 09: Use shared memory for hypo-dd write_correlations for 20 %…
flixha Mar 16, 2023
65d6af0
RCET enhancements (#539)
calum-chamberlain Mar 16, 2023
2c12f63
Merge branch 'develop' of https://github.com/eqcorrscan/EQcorrscan in…
calum-chamberlain Mar 16, 2023
6182e38
Convert preprocessing functions to multithreaded with GIL-released (#…
calum-chamberlain Mar 29, 2023
ed614d0
Merge branch 'develop' of https://github.com/eqcorrscan/EQcorrscan in…
calum-chamberlain Mar 30, 2023
c0bcffe
[WIP] Group templates by seed id (#541)
calum-chamberlain Mar 31, 2023
fdec1f0
Merge branch 'develop' of https://github.com/eqcorrscan/EQcorrscan in…
calum-chamberlain Mar 31, 2023
fcb89e3
Move data collection to seperate method
calum-chamberlain Mar 31, 2023
16f23dd
start making queue consumers
calum-chamberlain Apr 2, 2023
acda3bb
Possible implementation - untested
calum-chamberlain Apr 3, 2023
56e6e6c
Merge branch 'parallel-steps' of https://github.com/eqcorrscan/EQcorr…
calum-chamberlain Apr 3, 2023
d146c78
Process closing
calum-chamberlain Apr 3, 2023
d1e8b8e
Merge branch 'parallel-steps' of https://github.com/eqcorrscan/EQcorr…
calum-chamberlain Apr 3, 2023
fae3e2f
Enforce same processing and run all in detect
calum-chamberlain Apr 3, 2023
8ddd44f
Debugging
calum-chamberlain Apr 4, 2023
431c2c7
Merge branch 'parallel-steps' of https://github.com/eqcorrscan/EQcorr…
calum-chamberlain Apr 4, 2023
7f4e72e
Threshold in right place and allow pickle reading
calum-chamberlain Apr 5, 2023
6e7a679
Do not allow more threads than are available
calum-chamberlain Apr 5, 2023
6c5d26b
Find peaks needs to not request too many threads to avoid segfaults
calum-chamberlain Apr 5, 2023
f47bfb5
Parallel spike test
calum-chamberlain Apr 6, 2023
8da5896
Multi-find peaks using multithreading rather than openmp - faster and…
calum-chamberlain Apr 6, 2023
0b20a4e
Working concurrency
calum-chamberlain Apr 6, 2023
2cfbd3f
Faster party addition
calum-chamberlain Apr 6, 2023
f25620e
Return errors properly
calum-chamberlain Apr 9, 2023
a148503
Test correct place for cached files
calum-chamberlain Apr 9, 2023
c79935b
Check for None in add
calum-chamberlain Apr 9, 2023
4279dbd
termination
calum-chamberlain Apr 9, 2023
c081bd1
Remove multi find peaks
calum-chamberlain Apr 10, 2023
10097c7
timeout
calum-chamberlain Apr 10, 2023
944c60e
Do not test removed funcs
calum-chamberlain Apr 10, 2023
f936750
Develop and test serial implementation
calum-chamberlain Apr 10, 2023
a3be6cc
Cope with old tribes not having attributes
calum-chamberlain Apr 10, 2023
bb61c8c
Prep for correaltion in seperate process - can be slowdown for large …
calum-chamberlain Apr 10, 2023
ef6fa1f
Faster throughput and timers
calum-chamberlain Apr 10, 2023
af0c46d
More correaltion prep out of mainProcess
calum-chamberlain Apr 11, 2023
86ccdab
Make sure kwargs aren't changed
calum-chamberlain Apr 11, 2023
81b4b30
typos
calum-chamberlain Apr 11, 2023
f4e953e
Reduced streams held in memory at any time
calum-chamberlain Apr 11, 2023
bd407a9
Patch serial
calum-chamberlain Apr 11, 2023
4ac4f39
Merge branch 'parallel-steps' of https://github.com/eqcorrscan/EQcorr…
calum-chamberlain Apr 11, 2023
27d610d
Better memory management
calum-chamberlain Apr 12, 2023
df5cd26
Better error message if detctions out of range
calum-chamberlain Apr 12, 2023
dcb7779
typo
calum-chamberlain Apr 12, 2023
e5870fe
Allow slightly out correlations due to fp precision accumulation
calum-chamberlain Apr 12, 2023
36218cb
Empty the sid queue in serial
calum-chamberlain Apr 12, 2023
4ffd2fc
Empty the sid queue in serial
calum-chamberlain Apr 12, 2023
f60d568
Merge branch 'parallel-steps' of https://github.com/eqcorrscan/EQcorr…
calum-chamberlain Apr 12, 2023
2ce2510
Catch updated error
calum-chamberlain Apr 12, 2023
82cc9ee
Windows compat file names
calum-chamberlain Apr 12, 2023
d3dbed4
Limit rate of stream accumulation
calum-chamberlain Apr 13, 2023
27c269e
Merge branch 'parallel-steps' of https://github.com/eqcorrscan/EQcorr…
calum-chamberlain Apr 13, 2023
5e19763
Only pass template names through queue
calum-chamberlain Apr 13, 2023
44858a8
Limit downlaod rate
calum-chamberlain Apr 13, 2023
6b88898
Run serial downloads in serial
calum-chamberlain Apr 13, 2023
d338f15
Run serial downloads in serial
calum-chamberlain Apr 13, 2023
9c86178
Run most relevent test concurrent and serial
calum-chamberlain Apr 14, 2023
228de78
Precision should be per channel
calum-chamberlain Apr 14, 2023
5d2fd30
Only group when needed
calum-chamberlain Apr 14, 2023
4639c18
Make serial processing serial
calum-chamberlain Apr 14, 2023
3a712b7
debug wait
calum-chamberlain Apr 14, 2023
d2882a3
Enforce unique template names
calum-chamberlain Apr 16, 2023
5a9731f
Reduce copying, use disk for cache and reduce processes
calum-chamberlain Apr 17, 2023
1749060
Merge branch 'parallel-steps' of https://github.com/eqcorrscan/EQcorr…
calum-chamberlain Apr 17, 2023
81050a2
Stickler
calum-chamberlain Apr 17, 2023
d6b5a18
Stickler
calum-chamberlain Apr 17, 2023
adc3a9d
Raise errors properly
calum-chamberlain Apr 18, 2023
07ca579
Windows compat file names
calum-chamberlain Apr 18, 2023
b5dd6d2
Split and merge for stream IO - make tutorials run
calum-chamberlain Apr 18, 2023
aff2a50
Merge branch 'parallel-steps' of https://github.com/eqcorrscan/EQcorr…
calum-chamberlain Apr 18, 2023
f2cd9b9
Run concurrent first
calum-chamberlain Apr 18, 2023
0b2c3d1
Pickle rather than mseed - mseed has size limits
calum-chamberlain Apr 18, 2023
d31d6d1
Merge branch 'parallel-steps' of https://github.com/eqcorrscan/EQcorr…
calum-chamberlain Apr 18, 2023
f679dd1
Do not try to resample zero length data
calum-chamberlain May 26, 2023
32b823b
Do not try to filter zero length data
calum-chamberlain May 27, 2023
543bd32
Merge branch 'parallel-steps' of https://github.com/eqcorrscan/EQcorr…
calum-chamberlain Jul 13, 2023
a5ecf31
Do not edit lists within loops
calum-chamberlain Jul 13, 2023
81e51d5
debug output
calum-chamberlain Jul 13, 2023
1feda85
Merge branch 'parallel-steps' of https://github.com/eqcorrscan/EQcorr…
calum-chamberlain Jul 13, 2023
c65c262
Merge branch 'parallel-steps' of https://github.com/eqcorrscan/EQcorr…
calum-chamberlain Jul 17, 2023
4467e96
Catch template db deserialize errors; check for poison while waiting
calum-chamberlain Jul 17, 2023
bab2b90
Handle overlaps in client_detect properly
calum-chamberlain Jul 18, 2023
f58b692
Peaks plot should plot actual peak position
calum-chamberlain Jul 21, 2023
6c0e379
Merge branch 'develop' of https://github.com/eqcorrscan/EQcorrscan in…
calum-chamberlain Jul 21, 2023
304d6e8
Update plotting.py
calum-chamberlain Jul 25, 2023
cad133a
Merge branch 'parallel-steps' of https://github.com/eqcorrscan/EQcorr…
calum-chamberlain Jul 27, 2023
2bef502
Revert "Handle overlaps in client_detect properly"
calum-chamberlain Jul 27, 2023
030a929
More debug info for resampling - require double-precision
calum-chamberlain Sep 25, 2023
40cc0a0
Enforce catalog has events
calum-chamberlain Sep 25, 2023
efde3be
Debug differences in correlation due to one-sample out pre-resample
calum-chamberlain Sep 25, 2023
e27a80c
Cope with missing traces in remove
calum-chamberlain Sep 25, 2023
a493cca
Merge branch 'parallel-steps' of https://github.com/eqcorrscan/EQcorr…
calum-chamberlain Sep 26, 2023
a777084
Allow passing of pre-computed groupings to tribe.detect
calum-chamberlain Oct 2, 2023
2f76294
Allow passing of pre-computed groupings to tribe.detect
calum-chamberlain Oct 2, 2023
f1e89d7
Merge branch 'develop' into parallel-steps
calum-chamberlain Oct 21, 2023
af92623
Pull security and docs patches to develop. (#551)
calum-chamberlain Oct 21, 2023
7bfc89d
Merge branch 'develop' into parallel-steps
calum-chamberlain Oct 21, 2023
8cf4528
Reduce debug output
calum-chamberlain Oct 21, 2023
c8f4a38
Do not remove .parties directory
calum-chamberlain Oct 21, 2023
05fe64e
Merge branch 'parallel-steps' of https://github.com/eqcorrscan/EQcorr…
calum-chamberlain Oct 21, 2023
f25cada
Allow small variations due to processing differences
calum-chamberlain Oct 24, 2023
181d2ed
Retain double-precision in resample when given dp data
calum-chamberlain Oct 24, 2023
a1e22dc
Process unique directories for concurent work
calum-chamberlain Oct 24, 2023
77ea70a
Add loc kwarg for mpl update
calum-chamberlain Oct 24, 2023
1714f88
Merge branch 'develop' of https://github.com/eqcorrscan/EQcorrscan in…
calum-chamberlain Oct 24, 2023
3a070a4
Subspace use multi-processing
calum-chamberlain Oct 24, 2023
fe6559f
Patches for several failing tests (#552)
calum-chamberlain Oct 27, 2023
f30fc33
Merge branch 'develop' of https://github.com/eqcorrscan/EQcorrscan in…
calum-chamberlain Oct 27, 2023
f74e85f
Merge branch 'develop' into parallel-steps
calum-chamberlain Oct 27, 2023
e365f93
Merge branch 'parallel-steps' of https://github.com/eqcorrscan/EQcorr…
calum-chamberlain Oct 27, 2023
62baecf
Merge after gap check and before length thresholding
calum-chamberlain Oct 27, 2023
7a46eb9
Reduce query size
calum-chamberlain Oct 27, 2023
15832aa
Be slightly forgiving in time
calum-chamberlain Oct 27, 2023
aefd908
Don't run slow tests twice
calum-chamberlain Oct 27, 2023
307ede9
Remove spare print
calum-chamberlain Oct 27, 2023
70c6be8
Match timing significance (1 sample)
calum-chamberlain Oct 27, 2023
6b8ef05
Merge branch 'parallel-steps' of https://github.com/eqcorrscan/EQcorr…
calum-chamberlain Oct 29, 2023
c143d36
Move functions out for tribe for ease of maintaining
calum-chamberlain Nov 11, 2023
68de44d
Merge branch 'parallel-steps' of https://github.com/eqcorrscan/EQcorr…
calum-chamberlain Nov 14, 2023
3ff5029
Changelog
calum-chamberlain Nov 14, 2023
24988d7
Work on tutorial updates
calum-chamberlain Nov 16, 2023
b510a9f
Merge branch 'parallel-steps' of https://github.com/eqcorrscan/EQcorr…
calum-chamberlain Nov 16, 2023
92e776f
Use geonet AWS archive for data access
calum-chamberlain Nov 16, 2023
07c3cd7
Get dataset working
calum-chamberlain Nov 19, 2023
23a3257
Merge branch 'parallel-steps' of https://github.com/eqcorrscan/EQcorr…
calum-chamberlain Nov 19, 2023
acdff14
Filter picks
calum-chamberlain Nov 20, 2023
3d59d47
Merge branch 'parallel-steps' of https://github.com/eqcorrscan/EQcorr…
calum-chamberlain Nov 20, 2023
4d37db3
Complete tutorial
calum-chamberlain Nov 20, 2023
873dfd5
Cope with missing phase hints in picks
calum-chamberlain Nov 20, 2023
cb94fe1
Remove outdated tutorial tests
calum-chamberlain Nov 21, 2023
01c9361
Merge branch 'parallel-steps' of https://github.com/eqcorrscan/EQcorr…
calum-chamberlain Nov 21, 2023
52f9757
Debug output
calum-chamberlain Nov 26, 2023
14567b7
Merge branch 'parallel-steps' of https://github.com/eqcorrscan/EQcorr…
calum-chamberlain Nov 26, 2023
f1e6c31
README: Fix typo (#554)
yvonnefroehlich Nov 28, 2023
0c4dc2f
Do not use concurrent processing by default
calum-chamberlain Nov 28, 2023
c577ebd
Merge branch 'develop' into parallel-steps
calum-chamberlain Nov 28, 2023
229a00a
Merge branch 'parallel-steps' of https://github.com/eqcorrscan/EQcorr…
calum-chamberlain Nov 28, 2023
388d606
Do not run context manager in parallel when testing
calum-chamberlain Nov 28, 2023
3636578
Cope with files being cleaned early
calum-chamberlain Nov 28, 2023
cd929cb
Report on seed id overlap
calum-chamberlain Nov 28, 2023
5f575b1
Move from stickler to flake8 github actions (#555)
calum-chamberlain Nov 28, 2023
24d23ec
Merge branch 'develop' into parallel-steps
calum-chamberlain Nov 28, 2023
bc22d4b
Flake8
calum-chamberlain Nov 28, 2023
974f987
Merge branch 'parallel-steps' of https://github.com/eqcorrscan/EQcorr…
calum-chamberlain Nov 28, 2023
0476548
Flake8
calum-chamberlain Nov 28, 2023
4c0aecc
Standardise queue naming
calum-chamberlain Nov 30, 2023
3c00f57
Doc strings
calum-chamberlain Nov 30, 2023
cb557b6
Comment check
calum-chamberlain Dec 1, 2023
3ee0255
Do not build pdf by default
calum-chamberlain Dec 1, 2023
540fa89
Rerun notebook with only Warnings
calum-chamberlain Dec 1, 2023
0ab5811
More flexible codecov action version (#556)
calum-chamberlain Dec 1, 2023
c824ce0
Merge branch 'develop' into parallel-steps
calum-chamberlain Dec 1, 2023
51831c0
Enhance findpeaks coverage - remove unused _multi_decluster
calum-chamberlain Dec 1, 2023
1d703b9
Merge branch 'parallel-steps' of https://github.com/eqcorrscan/EQcorr…
calum-chamberlain Dec 1, 2023
47ca25f
Add pre-grouped test
calum-chamberlain Dec 1, 2023
0200767
Remove unused process
calum-chamberlain Dec 1, 2023
cd12ba8
Remove unused import
calum-chamberlain Dec 1, 2023
7e4f526
Check for errors in party check
calum-chamberlain Dec 1, 2023
f9f9ec1
Start testing helper processes
calum-chamberlain Dec 7, 2023
4eb31f5
flake8
calum-chamberlain Dec 7, 2023
cd5e2de
Paths
calum-chamberlain Dec 7, 2023
517c856
Raise exception, not poison
calum-chamberlain Dec 7, 2023
e8c6704
Wait for poison
calum-chamberlain Dec 7, 2023
299b988
Wait for poison
calum-chamberlain Dec 7, 2023
8132747
Wait longer
calum-chamberlain Dec 7, 2023
d24c9b3
Check print
calum-chamberlain Dec 7, 2023
ecd67fc
Merge branch 'parallel-steps' of https://github.com/eqcorrscan/EQcorr…
calum-chamberlain Dec 7, 2023
40e28b5
Restructure helper tests for re-use
calum-chamberlain Dec 8, 2023
0e2e5da
Basic tests for all processes
calum-chamberlain Dec 8, 2023
f5e81a5
Cope with Process coverage reporting
calum-chamberlain Dec 8, 2023
10e22e1
Merge branch 'parallel-steps' of https://github.com/eqcorrscan/EQcorr…
calum-chamberlain Dec 10, 2023
8cd77d7
Allow longer wait if needed
calum-chamberlain Dec 10, 2023
e59c0d9
Merge branch 'parallel-steps' of https://github.com/eqcorrscan/EQcorr…
calum-chamberlain Dec 10, 2023
c9b734e
Do not wait for output to be empty for too long
calum-chamberlain Dec 10, 2023
f5267a6
Report threading processing
calum-chamberlain Dec 10, 2023
9f26cb0
Tribe doctests
calum-chamberlain Dec 11, 2023
3c54c1d
REstructure archive access to cover more
calum-chamberlain Dec 11, 2023
4059450
Coverage
calum-chamberlain Dec 11, 2023
02643fa
typo
calum-chamberlain Dec 11, 2023
9d863b6
Test event similarity checks
calum-chamberlain Dec 11, 2023
7231e1a
Merge pull request #544 from eqcorrscan/parallel-steps
calum-chamberlain Dec 11, 2023
b245b99
Merge branch 'master' into develop
calum-chamberlain Dec 11, 2023
7030f04
Merge branch 'develop' of https://github.com/eqcorrscan/EQcorrscan in…
calum-chamberlain Dec 11, 2023
137690c
flake8
calum-chamberlain Dec 11, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .coveragerc
Original file line number Diff line number Diff line change
@@ -1,6 +1,7 @@
[run]
branch = True
source = eqcorrscan
concurrency = multiprocessing,thread
omit =
eqcorrscan/__init__.py
eqcorrscan/*/__init__.py
Expand Down
10 changes: 4 additions & 6 deletions .github/test_conda_env.yml
Original file line number Diff line number Diff line change
Expand Up @@ -5,9 +5,9 @@ channels:
dependencies:
- numpy>=1.12
- matplotlib>=1.3.0
- scipy>=0.18,<1.9.0 # Pinned due to scipy/obspy hanning renaming
- scipy
- mock
- obspy>=1.3.0
- obspy>=1.4.0
- h5py
- pyyaml
- bottleneck
Expand All @@ -17,8 +17,6 @@ dependencies:
- pytest-pep8
- pytest-xdist
- pytest-rerunfailures
- pytest-mpl<0.16.0
- pytest-mpl
- codecov
- pip
- pip:
- pyfftw
- boto3
31 changes: 17 additions & 14 deletions .github/test_conda_env_macOS.yml
Original file line number Diff line number Diff line change
@@ -1,23 +1,28 @@
name: eqcorrscan-test
channels:
- conda-forge
- defaults
dependencies:
- clangdev>=4
- openmp>=4
- libcxx>=4
- cctools
- clang
# Compiler bits to match conda-forge build env
- cctools_osx-64
- clang=14
- clang-14
- clang_osx-64
- llvm-openmp
- clangxx=14
- compiler-rt
- libcxx
- llvm-openmp>=4.0.1
- compiler-rt_osx-64
- ld64_osx-64
- libclang-cpp14
- libcxx=14
- libllvm14
- llvm-tools
# Normal requirements
- numpy>=1.12
- matplotlib>=1.3.0
- scipy>=0.18,<1.9.0 # Pinned due to scipy/obspy hanning renaming
- scipy
- mock
- obspy>=1.3.0
- h5py<3.2 # Issue with dep resolution: https://github.com/conda-forge/h5py-feedstock/issues/92
- obspy>=1.4.0
- h5py>3.3 # Issue with dep resolution: https://github.com/conda-forge/h5py-feedstock/issues/92
- pyyaml
- bottleneck
- fftw
Expand All @@ -28,6 +33,4 @@ dependencies:
- pytest-rerunfailures
- pytest-mpl<0.16.0
- codecov
- pip
- pip:
- pyfftw
- boto3
17 changes: 17 additions & 0 deletions .github/workflows/flake8-linter-matcher.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
{
"problemMatcher": [
{
"owner": "flake8-linter-error",
"severity": "error",
"pattern": [
{
"regexp": "^([^:]+):(\\d+):(\\d+):\\s+([EWCNF]\\d+\\s+.+)$",
"file": 1,
"line": 2,
"column": 3,
"message": 4
}
]
}
]
}
27 changes: 27 additions & 0 deletions .github/workflows/flake8.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,27 @@
name: Flake8 Linter
on:
pull_request:
jobs:
flake8-linter:
runs-on: ubuntu-latest
steps:
- name: Checkout source
uses: actions/checkout@v3
- name: Install Python 3.10
uses: actions/setup-python@v4
with:
python-version: '3.10'
- name: Install Flake8 5.0.4 linter
run: pip install flake8==5.0.4 # use this version for --diff option
- name: Setup Flake8 output matcher for PR annotations
run: echo '::add-matcher::.github/workflows/flake8-linter-matcher.json'
- name: Fetch pull request target branch
run: |
git remote add upstream https://github.com/eqcorrscan/EQcorrscan.git
git fetch upstream $GITHUB_BASE_REF
- name: Run Flake8 linter
run: git diff upstream/$GITHUB_BASE_REF HEAD | flake8
--exclude eqcorrscan/doc
--ignore W605,W504,W503
--max-line-length 80
--diff
99 changes: 36 additions & 63 deletions .github/workflows/runtest.yml
Original file line number Diff line number Diff line change
Expand Up @@ -8,12 +8,12 @@ jobs:
strategy:
matrix:
os: [ubuntu-latest, macos-latest, windows-latest]
python-version: ['3.7', '3.8', '3.9']
python-version: ['3.8', '3.9', '3.10', '3.11']
fail-fast: false
# continue-on-error: true

steps:
- uses: actions/checkout@v2
- uses: actions/checkout@v3

- name: Get conda env file
shell: bash -l {0}
Expand All @@ -22,31 +22,22 @@ jobs:
cp .github/test_conda_env_macOS.yml .github/test_conda_env.yml
fi

- name: Cache conda
uses: actions/cache@v2
env:
# Increase this value to reset cache if needed by env file has not changed
CACHE_NUMBER: 0
with:
path: ~/conda_pkgs_dir
key:
${{ runner.os }}-conda-${{ env.CACHE_NUMBER }}-${{
hashFiles('.github/test_conda_env.yml') }}

- name: Setup conda
uses: conda-incubator/setup-miniconda@v2
uses: conda-incubator/setup-miniconda@v2.1.1
with:
miniconda-version: 'latest'
miniforge-variant: Mambaforge
miniforge-version: latest
python-version: ${{ matrix.python-version }}
activate-environment: eqcorrscan-test
environment-file: .github/test_conda_env.yml
condarc-file: .github/test_condarc.yml
use-only-tar-bz2: true # Must be set for caching to work properly
use-mamba: true

- name: Update Env
run: mamba env update -n eqcorrscan-test -f .github/test_conda_env.yml

- name: install eqcorrscan
shell: bash -l {0}
run: |
pip install -e .
pip install -v -e . --no-deps

- name: print package info
shell: bash -l {0}
Expand All @@ -65,7 +56,7 @@ jobs:
- name: run main test suite
shell: bash -l {0}
run: |
py.test -n 2 -m "not serial and not network and not superslow" --cov-report=xml --dist loadscope
py.test -n 2 -m "not serial and not network and not superslow and not slow" --cov-report=xml --dist loadscope

- name: run serial test
if: always()
Expand All @@ -81,7 +72,7 @@ jobs:
py.test -v -m "slow and not serial and not network" --cov-report=xml --cov-append

- name: upload coverage
uses: codecov/codecov-action@v1
uses: codecov/codecov-action@v3
with:
token: ${{ secrets.CODECOV_TOKEN }}
file: ./coverage.xml
Expand All @@ -95,37 +86,28 @@ jobs:
runs-on: "ubuntu-latest"
strategy:
matrix:
python-version: [3.8]
python-version: ['3.10']
fail-fast: false

steps:
- uses: actions/checkout@v2

- name: Cache conda
uses: actions/cache@v2
env:
# Increase this value to reset cache if needed by env file has not changed
CACHE_NUMBER: 0
with:
path: ~/conda_pkgs_dir
key:
${{ runner.os }}-conda-${{ env.CACHE_NUMBER }}-${{
hashFiles('.github/test_conda_env.yml') }}
- uses: actions/checkout@v3

- name: Setup conda
uses: conda-incubator/setup-miniconda@v2
uses: conda-incubator/setup-miniconda@v2.1.1
with:
miniconda-version: 'latest'
miniforge-variant: Mambaforge
miniforge-version: latest
python-version: ${{ matrix.python-version }}
activate-environment: eqcorrscan-test
environment-file: .github/test_conda_env.yml
condarc-file: .github/test_condarc.yml
use-only-tar-bz2: true # Must be set for caching to work properly
use-mamba: true

- name: Update Env
run: mamba env update -n eqcorrscan-test -f .github/test_conda_env.yml

- name: install eqcorrscan
shell: bash -l {0}
run: |
pip install -e .
pip install -e . --no-deps

- name: print package info
shell: bash -l {0}
Expand All @@ -136,7 +118,7 @@ jobs:
- name: run network tests
shell: bash -l {0}
run: |
py.test -n 2 -m "network" --cov-report=xml
py.test -n 2 -m "network and not superslow" --cov-report=xml
- name: run tutorials
if: always()
shell: bash -l {0}
Expand All @@ -149,7 +131,7 @@ jobs:
py.test -m "superslow" -s eqcorrscan/tests/tutorials_test.py eqcorrscan/tests/subspace_test.py --cov-report=xml --cov-append

- name: upload coverage
uses: codecov/codecov-action@v1
uses: codecov/codecov-action@v3
with:
token: ${{ secrets.CODECOV_TOKEN }}
file: ./coverage.xml
Expand All @@ -162,40 +144,31 @@ jobs:
runs-on: "ubuntu-latest"
strategy:
matrix:
python-version: [3.8]
python-version: ['3.9']
fail-fast: false

steps:
- uses: actions/checkout@v2

- name: Cache conda
uses: actions/cache@v2
env:
# Increase this value to reset cache if needed by env file has not changed
CACHE_NUMBER: 0
with:
path: ~/conda_pkgs_dir
key:
${{ runner.os }}-conda-${{ env.CACHE_NUMBER }}-${{
hashFiles('.github/test_conda_env.yml') }}

- uses: actions/checkout@v3

- name: Setup conda
uses: conda-incubator/setup-miniconda@v2
uses: conda-incubator/setup-miniconda@v2.1.1
with:
miniconda-version: 'latest'
miniforge-variant: Mambaforge
miniforge-version: latest
python-version: ${{ matrix.python-version }}
activate-environment: eqcorrscan-test
environment-file: .github/test_conda_env.yml
condarc-file: .github/test_condarc.yml
use-only-tar-bz2: true # Must be set for caching to work properly
use-mamba: true

- name: Update Env
run: mamba env update -n eqcorrscan-test -f .github/test_conda_env.yml

- name: install fmf
shell: bash -l {0}
run: |
cd ..
git clone https://github.com/beridel/fast_matched_filter.git
cd fast_matched_filter
pip install -e .
pip install -e . --no-deps
cd ../EQcorrscan

- name: install eqcorrscan
Expand All @@ -216,7 +189,7 @@ jobs:
py.test eqcorrscan/tests/correlate_test.py --cov-report=xml

- name: upload coverage
uses: codecov/codecov-action@v1
uses: codecov/codecov-action@v3
with:
token: ${{ secrets.CODECOV_TOKEN }}
file: ./coverage.xml
Expand Down
3 changes: 2 additions & 1 deletion .readthedocs.yml
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,8 @@ sphinx:
configuration: eqcorrscan/doc/conf.py

# Optionally build your docs in additional formats such as PDF and ePub
formats: all
# See https://docs.readthedocs.io/en/stable/config-file/v2.html#formats
formats: []

# Optionally set the version of Python and requirements required to build your docs
python:
Expand Down
7 changes: 0 additions & 7 deletions .stickler.yml

This file was deleted.

Loading
Loading