2023.10 Fall Release

Web user interface

Added

  • RA, Dec ranges to results
  • Shift click to select contiguous rows in results
  • Links to Astroget python package
  • Threads to Nginx
  • Build of frontend code via makefile

Fixed

  • Select all visible
  • Update tests for ra,dec ranges

System Changes

Fixed

  • Ingest copies raw and pipeline files to different top-level directories
  • Ingest does not rename basename of pipeline files.

Added

  • Alpha version of pixel-level cutouts (one cutout at time)

Updated

  • software stack version upgraded (django 4.2, python 3.10, postgres 13, os [rocky 8])

2023.03 Winter Release

Web user interface

Fixed

  • 'No results found' when the results page takes time to load
  • Page loading was sometimes slow due to NAS
  • Changed links to Proposals - now using paths vs hashes

System Changes

Updated

  • Pre-release updates for updates to OS + Python/Django

2022.06 Spring Equinox Release

Web user interface

Added

  • New breadcrumbs for searches
  • Link from results to TAS proposal information

Fixed

  • Hover definitions not showing up in some cases
  • PI name consistency in results
  • Updated security packages
  • Fixed issue with downloading JSON/CSV results metadata
  • Unchangable date selection after initial search

System changes

Added

  • Retrieve service that uses archive basename instead of md5sum
  • Automated SSL certs

Fixed

  • Parsing OBJECT field in fits headers
  • Removed depricated services (FASearch/HASearch)

2022.02 Winter Solstice Release

Web user interface

Fixed

  • Login/logout indication on pages
  • Update lingering references to NOAO

Added

  • New results fields available (Object name, airmass, exposure number)
  • FAQ page
  • URL support for proposals/collections for direct results

System changes

Fixed

  • Internal endpoints to new TAS proposals

Updated

  • Started cleanup/restructure internal stack components

2022.01 PropID HotFix

System changes

Fixed

  • Add support for new Time Allocation System (TAS) proposal IDs.

2021.07 Summer Release 1

Web user interface

Fixed

  • Code View Beta clearing previous search criteria
  • Added direct link to HLSP collection
  • Layout/style changes to staging/download page for consistency
  • Updating collection view message when clearing search
  • Fix for results table sizing on very large/hi-res screens

Web services API (Advanced Search, SIA)

Added

  • API requests are now throttled. If too many API requests are made in a time interval, "Request was throttled" message will be returned instead of the normal results. Try later as per the message. Using authorizwed user credentials on an API call may invoke less restrictive throttling.

Fixed

  • Can now sort on AUX fields in FIND endpoint

2021.06 Domain name change

Web/System changes

Fixed

  • Updated internal systems and web UI to use the new noirlab.edu domain name.

Web user interface

Fixed

  • Sorting issue with 'seeing' column/field

2021.04 Spring Release 1

Web services API (Advanced Search, SIA)

Backwards incompatible changes

  • Result records are no longer sorted by default. To get previous behavior:
    • find/?sort=md5sum
    • find/?rectype=hdu&sort=fitsfile__md5sum,hdu_idx
    • fasearch/?sort=md5sum
    • hasearch/?sort=fitsfile__md5sum,hdu_idx

Deprecated

  • fasearch and hasearch will be removed in an upcoming release. Use find instead. The find endpoint has all the functionality of fasearch and hasearch combined into one call.

Added

  • Add "count" parameter to find (and fasearch and hasearch) endpoints. Using "&count=Y" in URL will return count of matches (quickly) instead returning the records.

  • Added "sort" parameter to find endpoint to enable field ordering. To sort HDU records "md5sum" (ascending) followed by "hdu_idx" (descending) use: find/?rectype=hdu&sort=fitsfile__md5sum,-hdu_idx

  • Added "offset" parameter to find endpoint. In combination with the "limit" parameter, this allows paging through results.

Fixed

  • Improved report of errors on invalid API json search spec.
  • Increased speed of API searches (fasearch, hasearch, find).
  • Default to rectype=file for api/find.
  • HEADER for response from fasearch,hasearch,find has better data types.
  • No longer require SURVEYID key in FITS file to be a known survey.
  • No longer sort when neither SORT nor OFFSET params given.

Web User Interface

Fixed

  • Fixed bug where sorting truncated results list by 1.
  • Made error message on object lookup more informative.

Added

  • Added prompt to notify search criteria is still active.
  • Added numerical comma on record count in results page
  • Added back-end user administration management commands

2021.02 Hotfix release

Web User Interface

Fixed

  • Fixed results where all RA values were same as Dec

2021.01 Winter Release

Web User Interface

Added

  • Lazy-loading results
  • Dynamic results height
  • Full resolution date_obs field in results

Changed

  • Updated download/staging terminology
  • Updated download instructions
  • Cleaned up old wiki generation instructions

Fixed

  • Fixed issue with Auth token when extra quotes present

Web services API (Advanced Search, SIA)

Added

  • Add adv_search/find API; Generalized search over combo of File and HDU
  • Added new core field to File ("user"). This can be searched on but not retrieved (for privacy reasons).
  • api/fcatalog/ provides list of all fields that can be used in find (with descriptions)

Fixed

  • obsmode populated
  • Time now included in date_obs field
  • api-authentication notebook no longer passes wrongly on attempt to get proprietary file without valid credentials
  • hasearch now correctly uses ra_min, ra_max, dec_min, dec_max
  • Advanced Search now handles CSV and XML output format correctly.

Release 2020.10 Schema and DB patch Release

Web services API (Advanced Search, SIA)

Added

  • ADDED FIELDS: FitsFile.dateobs, FitsFile.dateobs_center, FitsFile.ra_center, FitsFile.dec_center

Changed

  • api/version bumped to 5.0

Backwards incompatible changes

  • REMOVED FIELDS: Hdu.boundary
  • RENAMED FIELDS: Hdu.ra => Hdu.ra_center, Hdu.dec => Hdu.dec_center

Release 2020.09 Post-AAS Feedback Release

Web services API (Advanced Search, SIA)

Added

  • Additional search fields for SIA search (date,telescope,instrument,obs_type, proc_type, prod_type)
  • PARAMETERS now included in voimg,vohdu search results (except in format=csv)
  • The limit value in API search endpoints (/api/adv_search/fasearch/, /api/adv_search/hasearch/, /api/sia/vohdu, /api/sia/voimg) now supports a value of None. This will cause an unlimitted number of results to be returned. Use with caution! It might take a long time.
  • Advanced Search endpoints (/api/adv_search/fasearch/, /api/adv_search/hasearch/) now support a "url" output field. If this field is listed in outfields, it will contain a URL that will retrieve the related FITS file.
  • SIA query endpoints (/api/sia/vohdu, /api/sia/voimg) now always return a URL field that can be used to retrieve the related FITS file.

Fixed

  • Fixed bug in /api/short/ which artificially limited number of results returned

Changed

  • Moved /portal/object-lookup/ to /api/object-lookup/
  • VOTable output now includes proper "ucd" for Image_Title, POS_EQ_RA_MAIN, POS_EQ_DEC_MAIN, VOX:Image_AccessReference
  • VOTable contains VOX:Image_Format as a Param constant
  • Some error messages have been improved.

Backwards incompatible changes:

  • API searches now return a first element in the returned list that contains metadata. More changes to this element are expected. If you depend up on your may have to change. The results data is returned in list after the first element. Affected endpoints: (/api/adv_search/fasearch/, /api/adv_search/hasearch/, /api/sia/vohdu, /api/sia/voimg)

API search endpoints (/api/adv_search/fasearch/, /api/adv_search/hasearch/, /api/sia/vohdu, /api/sia/voimg)

Web User Interface

Fixed

  • Case insensitive search for PI
  • Ambiguous error messages
  • Clarify facets are limited
  • Fix to searches including RA, Dec not combining properly

Added

  • Automated release-notes
  • Links to release-notes everywhere
  • Ability to navigate search tabs using browser back/forwards buttons

Changed

  • Updated index mapping

Release 2020.06 <2020-07-08 Wed>

Web User Interface

Fixed

  • Some telescope/instrument searches included extraneous results
  • Handling values of 0 in results table
  • Single file downloads now using API download
  • Search form filter list incomplete

Added

  • Search using list of RA/DEC values
  • Saving search results as JSON/CSV
  • Link in search results to FITS headers

Changed

  • Converted category lists into drop-down lists with multi-select
  • Order of category columns matches results table column order
  • Code view matches Advanced search format

Web services API (Advanced Search, SIA)

Added

  • All API end-points are documented online. Each endpoint can be expanded to see parameters and to try out the web-service.

  • Info about what can be searched with Advanced Search is available via end-points:

    End-Point Info retrieved
    /api/adv_search/core_file_fields/ File DB fields
    /api/adv_search/aux_file_fields/ File FITS keywords
    /api/adv_search/fadoc/ How to construct the JSON payload for Advanced Search File queries.
    /api/adv_search/core_hdu_fields/ HDU DB fields
    /api/adv_search/aux_hdu_fields/ HDU FITS keywords
    /api/adv_search/hadoc/ How to construct the JSON payload for Advanced Search HDU queries.

  • Get fields known to be associated with given Instrument and Proctype from: https://astroarchive.noirlab.edu/api/fields/

  • Show the full FITS header (all HDUs) from any file in the archive (endpoint: api/header)

  • Get all the current valid values for "categorical fields" used in Archive files:

    • instruments
    • obsmodes
    • proctypes
    • prodtypes
    • sites
    • surveys
    • telescopes

  • Advanced Search shortcut: Get list of all files for specific telescope,instrument,night. (endpoint: short/<tele>/<inst>/<date>)

  • Allow Subject Matter Experts to add field descriptions to the database. These show in results of endpoints: core_file_fields, aux_file_fields, core_hdu_fields, aux_hdu_fields

Changed

  • Search constraint against PROPOSAL (fasearch, hasearch) now allows list of propids to match as the constraint parameters.
  • Better display of search modifiers for Advanced Search.

Backwards incompatible changes

  • Search constraint against PROPOSAL no longer uses string matching.

Archive

Fixed

  • Exposure time now being ingested correctly

Jupyter Notebooks

Added

**

  • advanced-search.ipynb Contains example usage of every web-service end-point
  • advanced-search.ipynb Contains examples of at least one of every type of search-constraint
  • exposure-map.ipynb Is an example Scientific Use-Case. It uses API to create an Exposure Map.

Release 2019.10 <2019-10-01 Tue>

Initial release. Includes features!