0.2.38 - 2022-08-16¶
Config server doesn’t initially parse config file so it doesn’t need to deserialize on response.
0.2.37 - 2022-08-09¶
panoptes-utils image watch <PATH>command with default processing that will convert
FITSand then plate-solve the
GHA downloads a
CR2file for testing.
Plot directives for documentation.
Testing now includes
--test-solvefor plate-solving in GHA.
Local tests only uses
Rearranged some functions in the
Unused stamp plotting functions.
Testing of config servers on GHA.
CountdownTimer.is_non_blocking predicate that wasn’t being used.
Extra serial protocol handlers.
panoptes-utilscli with sub-commands for converting CR2 to FITS and for plate-solving FITS.
4.2.3, which allows for
Updating example SerialDevice notebook and fixing deps.
Config server can now run on arbitrary ports better.
Removing unused functions: DelaySigTerm, strings_to_params.
Fixes to support 420 namespaces and pyscaffold.
Don’t deserialize all strings as dates unless they actually look like a date.
This release removes the Docker components from the repository, pushing some of the dependencies to
POCS. This is an attempt to make this module slimmer and more useful.
astrometry.netplate solving tests have been removed since we no longer build and test against a Docker image. The plate solving will continue to transition to the self-contained
panoptes.utils.serial.device.SerialDevicethat will replace the
rs232.SerialData. New class uses the threaded reader with optional callback for better asynchronous reading from a serial device. Example notebook included. #274
ObservationPathInfoallows for easy parsing of the standard PANOPTES file name scheme, as provided by
extract_metadatapulls FITS headers into a common dictionary structure. #282
Docker updates: Add
PYTHONUNBUFFEREDto docker files; Remove
deploykeys from docker compose files. #284
The serial protocol handlers were moved to the
Testing Dockerfile has
privilegedpermission to get device
condain Dockerfile before installing environment; install
panoptes-utilsmodule in user-editable mode. #277
condaforge/miniforge3as the base, which reduces image size. Push multi-stage builds for better caching. #278, #279
Consistent multi-stage names in Dockerfile; added
Change behavior of
baseentry must always exist or be missing (in which case the cwd is used). Remove the
Don’t nest storage objects for the
0.2.32 - 2020-03-19¶
panoptes.utils.rs232.find_serial_port()can be used to look up a serial port from the vendor and product hex ids. #269
defaultis the second parameter and function made less noisy overall. #272
Pillow>=8.1.1for dependabot alert. #273.
panoptes.utils.loggingwhich is just replaced by
from loguru import logger. # 272
0.2.32 - 2020-02-28¶
RGBIntEnum for easy iterating and consistent array access of rgb data. #265
save_rgb_bg_fitsthat will save a FITS files with seven extensions: combined rgb map, and then the background and rms maps for each color. #265
get_rgb_backgroundonly accepts a
dataargument and a filename can no longer be passed. #265
Updated defaults for
as_slicesparam added with default
Truefor legacy behavior. If
Falsethen just the four points are returned. #265
Test coverage will skip noqa markers and pytest will run all tests. #265
Added ruamel.yaml to base dependencies instead of just
The timeout parameter is now passed from get_solve_field to solve_field. #266
0.2.31 - 2020-01-31¶
Docker musical chairs:
Add Dockerfile to be
panoptes-utilsbut don’t use for testing. (#264)
panoptes-config-serveras default command example. (#264)
parse_config_directoriesno longer modifies dictionary in place. (#264)
Clean out the Contributing guide to point to POCS. (#264)
Removing unused new cli experiment. (#264)
PANLOGreferences. Closes #263. (#264)
astroplanfrom dependencies. (#264)
0.2.30 - 2021-01-14¶
Conda environment file (@wtgee #260)
A cli script for
panoptes-utils. This will eventually take over the
panoptes-config-serverand any other simple commands needed. For now can use
panoptes-utils tests runfor building and running tests.
Updated testing to use specific docker image. Updated run script for more specific options on starting testing config server. (@wtgee #260)
social. (@wtgee #260)
logurufor logging directly in all files, rather than needless import. (@wtgee #260)
CountdownTimer.sleep()less noisy. (#259)
Plate solving extras option parsing correctly. (@wtgee #260)
Explicit imports for some of the utils. (@wtgee #260)
Remove Docker services except for testing. (@wtgee #260)
Removed unused files: (@wtgee #260)
Example data fetching notebook removed.
Hotspot script removed.
Data (astrometry index and IERS) download removed.
TheSkyX utils moving to POCS directly.
Removed pipeline functions for getting
0.2.29 - 2020-10-21¶
oh-my-zshinstall file directly to ease some issues with GCP builds. (@wtgee #257)
source-extractorto dependencies but with no custom config files. (@wtgee #257)
Option to start a heartbeat or not. (@wtgee #248)
Reverting back to
python=3.7for compatibility w/ GCP notebooks. (@wtgee #255)
astropy<=4.0.1while we wait for
astroplanto get pushed. (@wtgee #255)
Changed the horizon module to use numpy interpolation so we don’t need to explicitly install scipy. (@wtgee #248)
altaz_to_radecaccepts astropy quantities. (@wtgee #250)
Downloaded helper script doesn’t have
python3hardcoded. (@wtgee #250)
Docker Tools (@wtgee #248):
Conda environment built from
resources/environment.yaml. (@wtgee #252)
Adds a “developer” dockerfile and compose file to install things for developers. (@wtgee #248)
Docker CMD will run ipython. (@wtgee #248)
docker-compose file will start a jupyter-lab instance. (@wtgee #248)
oh-my-zshpath for Docker install. (@wtgee #256)
Return testing output from docker container, passint exit status. (@wtgee #256)
starsmodule, which has been moved to
panoptes-pipeline. (@wtgee #251)
metadatamodule, which has been moved to
panoptes-pipeline. (@wtgee #252)
Docker Tools (@wtgee #248):
panoptes-utilsand move to
panoptes-pipeline. (@wtgee #252)
panoptes-utils. This is used for adding titles to JPGs. (@wtgee #252)
Don’t install a separate conda environment, just use the base to help reduce image size, complexity. (@wtgee #252)
Cleanup unused dependencies. (@wtgee @252)
Adios travis! (@wtgee #252)
0.2.28 - 2020-09-15¶
Add bit_depth argument to mask_saturated, no longer convert to float64 by default (@AnthonyHorton #244)
Single cloudbuild file for both
Remove the miniforge installer from the docker image and clean up build args. (@wtgee #245)
Changed relative to absolute imports. (@wtgee #246)
0.2.27 - 2020-09-12¶
Config server startup controlled via envvars, incorporating
Config server updates (@wtgee #241):
Config server with project dir mounted can be started via
Config server flask instances are run on
geventwsgi server instead of development server.
portare specified at the top-level command, e.g.
panoptes-config-server --host foobar --port 9999 get.
portrespect the above envvars above.
Options changed from
runcommand adds the``config_server.running=True`` entry to the server.
stopcommand added that sets
config_server.running=Falseto break loop.
Testing (@wtgee #241):
All testing is started from
panoptes-config-serveris started as an external service, not in the pytest conf.
tests/envfile that is used by the docker compose file for setting vars inside the running containers.
Config server uses
tests/testing.yamlfor all testing.
Testing logs are stored in
./logs, relative to the project root outside the container.
Coverage file is stored in
scripts/wait-for-it.shscript added to check that config server is running properly before starting tests.
scripts/setup-local-environment.shproperly uses new base image if requested. (@wtgee #241)
Docker images: fixed the created
$PANUSER. (@wtgee #240)
0.2.26 - 2020-08-21¶
This release is mostly cleanup and testing of our autobuild features.
panoptes-basefiles into separate folder. (#238)
Consolidate the GitHub Actions for building and publishing a release package. (#239)
Fix Github Actions for building releases. (#238)
0.2.25 - 2020-08-20¶
Google Cloud Build of Docker images.
panoptes-utilsare built for each PR as well as on merges to
If a semantically tagged branch is pushed to GH, a release will automatically be generated and a package will be built and sent to PyPi. (#237)
Changelog fixes. (#237)
0.2.23 - 2020-08-16¶
Simplified docker docker images. (#227)
Consolidation of Dockerfile to support images:
panoptes-baseserves as a base image for all docker services.
panoptes-utilsmodule from github
panoptes-utils:developis used for testing and can be built locally with the
Tests on GH and Travis use the
docker/setup-local-environment.shscript for building test images.
miniforge used to install a
conda-forgeas default channels. Forces 64bit support.
Multi-arch builds are supported on
cloudbuild.yamlfile. Built with
buildxplugin to docker. Currently
Extra zsh plugins in the docker image.
Properly disable auto-update of zsh.
Cleanup of entrypoint for better loading of environment.
pyarrowtoo hard to build on arm.
holoviewsnot needed in default install.
0.2.22 - 2020-07-25¶
directoryin disk space check. (#226)
Pass the git folder to the build context when making local docker images. (#226)
0.2.21 - 2020-07-05¶
arm64build for Docker based off
Changed base image to
arm64images built by default. (#223)
Ubuntu has changed
Better parsing of directories entry in config server. (#222)
Make config server less noisy. (#222)
Bump PyYaml to latest for security warning. (#222)
Remove pendulum because too hard to build on arm processors. (#223)
0.2.20 - 2020-06-09¶
Moving to python 3.8.
Breaking Python minimum version changed to
Running pytest locally will generate coverage report in terminal. (#218)
Lots of documentation. (#218)
Removing the environment section from the readme. (#218)
Config Server (#217)
Cleaning up doctests.
Removing all dynamic server items from this repo as they are not needed.
Wait for config_server to start.
Fixing starting within fixture.
Config items no longer assume any defaults for either directories or files. A config file name is always required and it should always be an absolute path. (#218)
Adding test file for config items. (#218)
panoptes-config-serverre-worked and now includes
Log files are rotated for each testing run.
Fix env vars (mostly need to make sure the
exportoption exists in the
Pytest commands moved to
Remove old markers
astrometrymarker for tests requiring solve and
theskyxmarker for running alongside TheSkyX.
Coverage reports generated in xml and output in terminal.
Serializers update. (#217)
Make the parsing and serializing functions public.
Use pendulum for parsing times instead of astropy Time.
Better naming of public functions. (#218)
0.2.19 - 2020-06-04¶
bin/panoptes-config-serverand created an entry_point in
Removed old developer items in favor of those in
Consolidate docker files, consistent naming with other repos. (#210, #212)
0.2.17 - 2020-05-30¶
0.2.16 was released with an error and this is a hotfix.
Added CR2 file testing to GitHub Actions. (#125, #205)
wait_for_eventsgeneric utility, mostly pulled from POCS. (#92, #206) * Supports single
callbackthat can be used for interrupting, custom logging, etc. (#208)
validate_collectionrequirement from the database types, making any collection is now valid. (#204)
Rearrange some of the
Unused items in
0.2.15 - 2020-05-26¶
Convert to pyscaffold. (#198)
Proper namespace package
Move items to
Fix version number.
Fix documentation #27.
Move all project config to
Base Docker image is run by root only.
testingDockerfile and cleaned up
Breaking Removing all zmq based messaging services. (#200)
0.2.14 - 2020-05-23¶
Add snappy decompression for parquet;
Password-less sudo for panoptes user on dev docker image (#193)
get_metadatahas an optional progress bar. (#194)
bayer.get_stamp_slicefor getting a stamp slice while respecting the superpixel. This was removed awhile ago and has been re-added and improved. (#196) * Adjusting the offsets so the center pixel is always:
G2 B R G1
Fix time-based search (#193)
Fix the build (#197) * Removed
versioneerin favor of
setuptools-scmfor workin version numbers. * Removed the MANIFEST.in * Added a simple
Breaking Only support getting stars directly from the WCS, not the footprint. (#194) *
get_stars_from_wcs* Better logging * Consistent column names for dtypes * Vmag bin comes from sql. * Allow for different RA/Dec column names. * Better catalog match function.
sextractorparam changes. (#194)
panoptes.utils.loggerso we can
from panoptes.utils import logger(#197)
- Breaking The
panoptes.utils.data.assetsmodule was removed and the
Downloaderclass is placed directly within the
- Breaking The
panopes-utilsmodule is not installed in editable mode in the
latestdocker image. (#197) * Slight clean up of latest.Dockerfile
0.2.13 - 2020-05-14¶
Fix some passing of options between
solve_fieldthat was leading to double parameter issues. (#189)
panoptes.utils.datafunctions use static versions of the file rather than firestore. (#192)
Updated development environment (#191)
get_metadatafilter the fields at the parquet level. (#194)
0.2.12 - 2020-04-29¶
Quick release to get the
panoptes.utils.sources into the package.
panoptes.utils.sourcesnot included in package. (#187, #188)
Ability to pass credentials to underlying google client functions. (#187)
0.2.11 - 2020-04-29¶
Added basic data access components for getting observation and image metadata. (#178, #181)
- Added a
search_observationsfunction for searching by various criteria. (#181)
Uses anonymous credentials to connect to firestore.
Added a basic notebook demonstrating features.
- Added a
hvplotas required dependencies.
- FITS Utils fixes:
Fix docstring return types for some functions. (#173)
get_solve_fieldwere not properly overwriting FITS files
under certain conditions when an uncompressed file of the same name was present alongside the compressed version. (#175)
Changed developer tag from
- FITS Utils changes (#173):
Uncompressed file is always used for solve because we were occasionally seeing odd errors as described in dstndstn/astrometry.net#182. (#173)
Better log output for solving.
Better checking for solved file at end (via
Cleanup the cleanup of solve files, removing
write_fits. Needed for, e.g.
Allow additional options to be passed to solve field functions without having to override all options. (#180)
- Changed default options in
- Changed default options in
bin/panoptes-developfor naming consistency. (#175)
panoptes.utils.data.pyhas moved into the
panoptes.utils.datanamespace with the relevant existing
Downloaderclass placed in the
get_data(and images and observations equivalent) to
- FITS Utils removals (#173):
Removing unused and confusing
PanLogger class moved to POCS. (#186)
0.2.10 - 2020-04-13¶
get_stars_from_footpr intcan accept a
WCSdirectly instead of just the output from
Ability to create different tags for the docker image. The
developdirectory is now used to create a
developimage and is provided along with
get_rgb_backgrounds(return_separate-True)will now return the
Added BigQuery pandas dependencies. (#168)
Added a developer image at
panoptes-utils:dev, which is also auto-built along with the
latestin the cloudbuild. Offers a
jupyter-labinstance along with a number of plotting modules. Can be easily started via
panoptes-dev. (#170, #171)
sequence_id_from_pathcan recognize a zero in the
Nonewhen no match. (#163)
Fixed the bigquery client param for star lookup. (#164)
Unquote paths before id matching. (#169)
Do WCS match for all unmatched sources, not just matched sources. (#172)
Docker entrypoint no longer tries to activate service account if
$GOOGLE_APPLICATION_CREDENTIALSis found. The python client libraries will recognize the env var so this means we can avoid installing
gcloudutilities just to activate. (#165)
sourcesmodule does not require a BigQuery client to be passed but can start it’s own. A warning is given if
$GOOGLE_APPLICATION_CREDENTIALSis not found. (#167)
lookup_point_sourcesupdates: default vmag range expanded so less false positive matches [4,18). (#168)
Removed TOC from changelog. (#170)
Sextractor param changes: (#171) * Threshold for detection changed from 3 pixels to 10 pixels. * Seeing changed from 0.7 arcsec to 15.3 arcsec. (Isn’t used.) * Removed
class_starfrom sextractor results.
0.2.9 - 2020-03-27¶
Pointless version bump because of issue with PyPi.
0.2.8 - 2020-03-27¶
Thanks first-time contributer @preethi524! :tada:
Ability to return separate RGB backgrounds. (#162)
Increase coverage. (#161)
0.2.7 - 2020-03-22 (hotfix)¶
Basic serialization of
0.2.6 - 2020-03-22¶
get_rgb_backgroundadded to the
getwcsthin-wrapper added to
Changed scope of test data files to
python:3.8-slim-busterfor base image. Only
amd64support for now. (#155)
Simplified docker files. (#155)
Switching from Travis to GHA: (#155)
Travis builds docker image before testing.
Travis doesn’t upload coverage.
Don’t update module inside container during entrypoint.
Fixed user permissions for $HOME and $PANDIR. (#155)
The docker container only really likes it when user id
1000is running the system.
Remove GCP Cloud SQL proxy support.
panoptesuser has password
Polar alignment utils (#156)
0.2.5 - 2020-03-18¶
Github Actions testing and coverage upload. (#145) * Log files for testing are created as an artifact.
PanLoggerhelper class added. Mostly handles formatting but can also track handlers. (#145)
Fixed top-level namespace so we can have other
panoptesrepos. (#150, fixes #137)
Data files for testing are copied before tests. Allows for reuse of unsolved fits file. (#144)
Fix astrometry data file directories in Docker images. (#144)
The docker image no longer updates
0.2.4 - 2020-03-11¶
Disallow zipped packages, which also interfere with namespace (#142)
photutilsdependency for rectangular apertures in the
0.2.3 - 2020-03-08¶
Small point release to correct namespace and remove some bloat.
Fixed top-level namespace so we can have other
Dependencies that will be deprecated soon and are causing bloat:
Fixed top-level namespace so we can have other
panoptesrepos (#137, #150).
0.2.2 - 2020-03-05¶
Mostly some cleanup from the
v0.2.0 release based on integrating all the changes into POCS.
Misc bugs introduced as part of last release, including to
Custom exceptions now properly pass
kwargsthrough to parent (#135).
New script for downloading data,
scripts/download-data.py. This helped resolve some issues with the relative imports introduced in
v0.2.0and is cleaner. (#129)
All dependencies are smashed into one “feature” in
pip-toolswork well. This will fix the docker image problems introduced in
get_root_loggerand associated tests (#134).
0.2.0 - 2020-03-04¶
First big overhaul of the repository. Pulls in features that were duplicated or scattered across POCS and PIAA. Removes a lot of code that wasn’t being used or was otherwise clutter. Overhauls the logging system to use [
loguru](https://github.com/Delgan/loguru) so things are simplified. Updates to documentation.
See the description in the [README](README.md)
Versioneer for version strings (#123).
Read the docs config (#123).
IERS Mirror (#65, #67)
See #68 and #75 for list.
Switch to loguru. This simplifies our logging system. Also gives us access to the
debug, good for hardware and other debug we don’t need to see during operation) and
info) levels, which would be nice to start implementing. (#123)
Consistent use of relative imports. (#123)
Documentation updates. (#97, #119, #120, #123)
Repo cleanup. (#97, #123)
Using GitHub Actions for testing. (#100, #101)
Using pip-tools for dependency management.
0.1.0 - 2020-03-04¶
Changes and cleanup on the way to a (more) stable release. See
0.2.0 for list of changes.
0.0.8 - 2019-06-29¶
Bringing things in line with updates to
POCS for docker and
Serial handlers move to panoptes-utils from POCS.
Tests and coverage.
improve_wcs(moved from PIAA).
~utils.fits.getdatato match other fits convenience functions, allowing for fpack files.
Use our serialization everywhere (e.g. messaging)
Scripts are renamed to have
Scripts are installed as part of setup.
Script improvements to make more robust and portable.
Don’t use anaconda.
Overhaul of config_server use in testing.
Testing config file is separated from any regular config files.
Silence some 3rd party logs.
0.0.7 - 2019-05-26¶
Added bayer utilities. :camera:
Added Cloud SQL utilities. :cloud:
Breaking Changed namespace so no underscores, i.e.
from panoptes.utils import time.
Use slim python images and not anaconda on amd64.
Adding zsh as default shell along with some customizations.
Entrypoint script properly authenticates to google cloud if possible.
Added amd64 only build scripts.
0.0.6 - 2019-04-29¶
Docker containers created:
panoptes-basefor base OS and system packages, including astrometry.net and friends.
panoptes-utilsfor container containing base utilities.
Script for building containers in GCR.
Consistent JSON and YAML serializers.
Configuration Server (Flask/JSON microservice).
Minimum Python version is 3.6
Default PanDB type is changed to
Bux fixes and code improvements.
0.0.5 - 2019-04-09¶
Added a change log. Yay.
orjsonand revert to
jsonfor the JSON serializers.