Bug: query_plate_mjd_fiber error in Chapter 1

As I run the following

from astroML.datasets import tools
target = tools.TARGET_GALAXY # main galaxy sample
plt, mjd, fib = tools.query_plate_mjd_fiber(5, primtarget=target)

following the content in page 20 of the textbook, I got a 404 error. I found that the web in PUBLIC_URL = 'http://cas.sdss.org/public/en/tools/search/x_sql.aspx' in conde sql_query.py does not exist so I change it to PUBLIC_URL = 'http://cas.sdss.org/dr18/SearchTools/sql' The page can then be connected but it output the following error messages (part of the message is cut off since it is too long):

---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
File ~/opt/anaconda3/envs/astroml/lib/python3.10/site-packages/astroML/datasets/tools/cas_query.py:77, in query_plate_mjd_fiber(n_spectra, primtarget, zmin, zmax)
     76 try:
---> 77     res[i] = line.decode().strip().split(',')
     78 except BaseException:

ValueError: invalid literal for int() with base 10: '<html lang="en">'

During handling of the above exception, another exception occurred:

ValueError                                Traceback (most recent call last)
Cell In[1], line 3
      1 from astroML.datasets import tools
      2 target = tools.TARGET_GALAXY # main galaxy sample
----> 3 plt, mjd, fib = tools.query_plate_mjd_fiber(5, primtarget=target)

File ~/opt/anaconda3/envs/astroml/lib/python3.10/site-packages/astroML/datasets/tools/cas_query.py:79, in query_plate_mjd_fiber(n_spectra, primtarget, zmin, zmax)
     77         res[i] = line.decode().strip().split(',')
     78     except BaseException:
---> 79         raise ValueError(b'\n'.join(output))
     81 ntot = i + 1
     83 return res[:ntot].T

ValueError: b'\r\n\n<!doctype html>\r\n\n<html lang="en">\r\n\n<head>\r\n\n    \r\n\n    <meta charset="utf-8">\r\n\n    <meta name="viewport" content="width=device-width, initial-scale=1, shrink-to-fit=no">\r\n\n    \r\n\n    <meta name="description" content="SciServer\'s SkyServer is for providing Sloan Digital Sky Survey (SDSS) data to the public" />\r\n\n    <title>SQL Search - SkyserverSDSS</title>\r\n\n\r\n\n    <link href="https://fonts.googleapis.com/css?family=Roboto:300,400|Rokkitt|Roboto+Mono" rel="stylesheet">\r\n\n    <link rel="stylesheet" href="https://use.fontawesome.com/releases/v5.7.2/css/all.css" integrity="sha384-fnmOCqbTlWIlj8LyTjo7mOUStjsKC4pOpQbqyi7RrhN7udi9RwhKkMHpvLbHG9Sr" crossorigin="anonymous">\r\n\n\r\n\n    \r\n\n        \r\n\n    <link rel="stylesheet" href="//code.jquery.com/ui/1.12.1/themes/base/jquery-ui.css">\r\n\n    <link rel="stylesheet" type="text/css" href="/dr18/css/skyserver.css" />\r\n\n\r\n\n    \r\n\n    \r\n\n    \r\n\n        \r\n\n        \r\n\n        <script src="https://code.jquery.com/jquery-3.4.1.min.js" integrity="sha256-CSXorXvZcTkaix6Yvo6HppcZGetbYMGWSFlBw8HfCJo=" crossorigin="anonymous"></script>\r\n\n        <script src="https://cdnjs.cloudflare.com/ajax/libs/popper.js/1.14.7/umd/popper.min.js" integrity="sha384-UO2eT0CpHqdSJQ6hJty5KVphtPhzWj9WO1clHTMGa3JDZwrnQq4sF86dIHNDz0W1" crossorigin="anonymous"></script>\r\n\n        <script src="https://stackpath.bootstrapcdn.com/bootstrap/4.3.1/js/bootstrap.min.js" integrity="sha384-JjSmVgyd0p3pXB1rRibZUAYoIIy6OrQ6VrjIEaFf/nJGzIxFDsf4x0xIM+B07jRM" crossorigin="anonymous"></script>\r\n\n        \r\n\n        <script src="/dr18/js/skyserver.js"></script>\r\n\n    \r\n\n    \r\n\n    \r\n\n    <script src="https://code.jquery.com/ui/1.12.1/jquery-ui.js"></script>\r\n\n    <script type="text/javascript" src="https://cdnjs.cloudflare.com/ajax/libs/ace/1.4.3/ace.js"></script>\r\n\n    <script type="text/javascript" src="https://cdnjs.cloudflare.com/ajax/libs/ace/1.4.1/ext-language_tools.js"></script>\r\n\n    <script src="/dr18/js/sqlsearch.js"></script>\r\n\n\r\n\n</head>\r\n\n<body id="searchtools">\r\n\n<style>\r\n\n    #supportDropdown {\r\n\n        min-width: 400px;\r\n\n    }\r\n\n</style>\r\n\n<nav class="index-nav navbar sticky-top navbar-expand-md navbar-dark bg-blue text-semi-transparent sci-nav">\r\n\n    <button class="navbar-toggler" type="button" data-toggle="collapse" data-target="#sticky-nav" aria-controls="sticky-nav" aria-expanded="false" aria-label="Toggle navigation">\r\n\n        <span class="navbar-toggler-icon"></span>\r\n\n    </button>\r\n\n    <div class="collapse navbar-collapse" id="sticky-nav">\r\n\n        <ul class="navbar-nav nav">\r\n\n            <li class="nav-item nav-link"><a href="/dr18">Home</a></li>\r\n\n\r\n\n            <li class="nav-item dropdown">\r\n\n                <a class="nav-link dropdown-toggle" id="dropdownMenu" role="button" data-toggle="dropdown" aria-haspopup="true" aria-expanded="false">\r\n\n                    Visual Tools\r\n\n                </a>\r\n\n                <ul class="dropdown-menu bg-purple" aria-labelledby="dropdownMenu">\r\n\n                    <li class="dropdown-item"><a href="/dr18/VisualTools">Overview</a></li>\r\n\n                    <li class="dropdown-item"><a href="/dr18/VisualTools/navi">Navigate</a></li>\r\n\n                    <li class="dropdown-item"><a href="/dr18/VisualTools/explore/summary">Explore</a></li>\r\n\n                    <li class="dropdown-item"><a href="/dr18/VisualTools/explore/chartinfo">Finding Chart</a></li>\r\n\n                    <li class="dropdown-item"><a href="/dr18/VisualTools/quickobj">Quick Look</a></li>\r\n\n                    <li class="dropdown-item"><a href="/dr18/VisualTools/list">Image List</a></li>\r\n\n                </ul>\r\n\n            </li>\r\n\n            <li class="nav-item dropdown">\r\n\n                <a class="nav-link dropdown-toggle" id="dropdownMenu" role="button" data-toggle="dropdown" aria-haspopup="true" aria-expanded="false">\r\n\n                    Search Tools\r\n\n                </a>\r\n\n                <ul class="dropdown-menu bg-purple" aria-labelledby="dropdownMenu">\r\n\n                    <li class="dropdown-item"><a href="/dr18/SearchTools">Overview</a></li>\r\n\n                    <li class="dropdown-item"><a href="/dr18/SearchTools/sql">SQL Search</a></li>\r\n\n                    \r\n\n                    <li class="dropdown-item"><a href="/dr18/SearchTools/rect">Rectangular Search</a></li>\r\n\n                    <li class="dropdown-item"><a href="/dr18/SearchTools/radial">Radial Search</a></li>\r\n\n                    <li class="dropdown-item"><a href="/dr18/SearchTools/IQS">Imaging Search</a></li>\r\n\n                    <li class="dropdown-item"><a href="/dr18/SearchTools/SQS">Spectroscopic Search</a></li>\r\n\n                    <li class="dropdown-item"><a href="/dr18/SearchTools/IRQS">IR Spectroscopic Search</a></li>\r\n\n                </ul>\r\n\n            </li>\r\n\n            <li class="nav-item dropdown">\r\n\n                <a class="nav-link dropdown-toggle" id="dropdownMenu" role="button" data-toggle="dropdown" aria-haspopup="true" aria-expanded="false">\r\n\n                    CrossMatch Tools\r\n\n                </a>\r\n\n                <ul class="dropdown-menu bg-purple" aria-labelledby="dropdownMenu">\r\n\n                    <li class="dropdown-item"><a href="/dr18/CrossMatchTools">Overview</a></li>\r\n\n                    <li class="dropdown-item"><a href="/dr18/CrossMatchTools/ObjectCrossID">CrossMatch ID</a></li>\r\n\n                    \r\n\n                </ul>\r\n\n            </li>\r\n\n            <li class="nav-item dropdown">\r\n\n                <a class="nav-link dropdown-toggle" id="dropdownMenu" role="button" data-toggle="dropdown" aria-haspopup="true" aria-expanded="false">\r\n\n                    More Tools\r\n\n                </a>\r\n\n                <ul class="dropdown-menu bg-purple" aria-labelledby="dropdownMenu">\r\n\n                    <li class="dropdown-item"><a href="/dr18/MoreTools">Overview</a></li>\r\n\n                    <li class="dropdown-item"><a href="/dr18/MoreTools/UserHistory">My History</a></li>\r\n\n                    <li class="dropdown-item"><a href="/dr18/MoreTools/browser">Schema Browser</a></li>\r\n\n                    <li class="dropdown-item"><a href="/dr18/MoreTools/scrollhome">Scrolling Sky</a></li>\r\n\n                    <li class="dropdown-item"><a href="/dr18/MoreTools/fields">Get Fields</a></li>\r\n\n                    <li class="dropdown-item"><a href="/dr18/MoreTools/spectra">Get Spectra</a></li>\r\n\n                    <li class="dropdown-item"><a href="/dr18/MoreTools/plate">Get Plates</a></li>\r\n\n                </ul>\r\n\n            </li>\r\n\n            <li class="nav-item dropdown">\r\n\n                <a class="nav-link dropdown-toggle" id="dropdownMenu" role="button" data-toggle="dropdown" aria-haspopup="true" aria-expanded="false">\r\n\n                    Support\r\n\n                </a>\r\n\n                <ul id="supportDropdown" class="dropdown-menu bg-purple" aria-labelledby="dropdownMenu">\r\n\n                    <li class="dropdown-item"><a href="/dr18/Support">Overview</a></li>\r\n\n                    <li class="dropdown-item"><a href="/dr18/Support/intro">About the Data</a></li>\r\n\n                    <li class="dropdown-item"><a href="/dr18/MoreTools/browser">Schema Browser</a></li>\r\n\n\r\n\n                    <li class="dropdown-item"><a href="/dr18/Support/realquery">Sample Queries</a></li>\r\n\n                    <li class="dropdown-item"><a href="/dr18/Support/sql_help">SQL in SkyServer</a></li>\r\n\n                    <li class="dropdown-item"><a href="/dr18/Support/Advice">Query Advice</a></li>\r\n\n                    <li class="dropdown-item"><a href="/dr18/Support/Api">APIs</a></li>\r\n\n                    <li class="dropdown-item"><a href="https://skyserver.sdss.org/dr16/en/help/howto/search/searchhowtohome.aspx" target="_blank">SQL Tutorial (DR16) <span class="fas fa-external-link-alt"></span></li>\r\n\n                    <li role="separator" class="divider"></li>\r\n\n                    <li class="dropdown-item"><a href="/dr18/Support/contact">Contact</a></li>\r\n\n                    \r\n\n                        <li role="separator" class="divider"></li>\r\n\n                    \r\n\n\r\n\n                </ul>\r\n\n            </li>\r\n\n            \r\n\n            <li class="nav-item nav-link"><a href="http://casjobs.sdss.org/casjobs/" target="_blank">CasJobs <span class="fas fa-external-link-alt"></span></a></li>\r\n\n        </ul>\r\n\n    </div>\r\n\n<div class="mx-md-2 py-2">\r\n\n    <a href="#" onclick="window.location.href = \'[https://apps.sciserver.org/login-portal/Account/Login\](https://apps.sciserver.org/login-portal/Account/Login/)' + \'?callbackUrl=\' + window.location.href;">Sign In <i style="font-size:12px;" class="fas fa-external-link-alt"></i></a>\r\n\n</div></nav>    <div class="container-fluid wrapper">\r\n\n        <div class="row">\r\n\n            <div class="col-auto d-none d-md-block bg-purple sidebar sidebar-sticky">\r\n\n                <ul class="nav flex-column">\r\n\n                    <li class="nav-link"> <a href="/dr18/SearchTools">Overview</a></li>\r\n\n                    <li class="nav-link"> <a href="/dr18/SearchTools/sql">SQL Search</a></li>\r\n\n                    \r\n\n                    <li ----------------------------------------------------------------------------------------------------------------- -->\r\n\n    <div class="card mt-1">\r\n\n        <div id="mastar" class="card-header collapsed" data-toggle="collapse" href="#mastar-body" aria-expanded="false" aria-controls="mastar-body">\r\n\n            MaStar\r\n\n        </div>\r\n\n        <div id="mastar-body" class="card-body collapse bg-purple p-2" data-parent=#mastar>\r\n\n            <a href="#" class="list-group-item rounded my-1 p-2" onclick="loadQuery(this)">\r\n\n                MaStar Selecting G-stars\r\n\n                <div class="sample-query-text d-none">-- Selecting G-stars from mastar_goodstars_params\r\n\n-- This query returns the stellar parameters for the first 100 G-stars in the mastar_goodstars table.\r\n\n-- G-stars are selected using a temperature criterion.\r\n\n\r\n\nSELECT \r\n\n    TOP 100 mangaid, teff_med, logg_med, feh_med, alpha_med\r\n\nFROM mastar_goodstars_params\r\n\nWHERE teff_med BETWEEN 5000 AND 6000</div>\r\n\n            </a>\r\n\n            <a href="#" class="list-group-item rounded my-1 p-2" onclick="loadQuery(this)">\r\n\n                MaStar Stars near cluster center\r\n\n                <div class="sample-query-text d-none">-- Selecting stars near cluster center\r\n\n-- This query returns the coordinates and parameters for stars within 0.5 degrees of\r\n\n-- the open cluster M67 (central coordinates 132.83, 11.82) in the mastar_goodstars_params\r\n\n-- the mastar_goodstars_params table that have been observed more than once (nvisits).\r\n\n\r\n\nSELECT \r\n\n    mangaid, nvisits, ra, dec, teff_med, logg_med, feh_med, alpha_med\r\n\nFROM \r\n\n    mastar_goodstars_params\r\n\nWHERE\r\n\n    POWER(ra - 132.83, 2) + POWER(dec - 11.82, 2) < POWER(0.5, 2)\r\n\n    AND nvisits >= 2</div>\r\n\n            </a>\r\n\n            <a href="#" class="list-group-item rounded my-1 p-2" onclick="loadQuery(this)">\r\n\n                MaStar High-velocity stars\r\n\n                <div class="sample-query-text d-none">-- Selecting High Velocity Stars in mastar_goodvisits\r\n\n-- This query returns radial velocities, uncertainties, and Gaia photometry\r\n\n-- for stars with velocities > 300 km/s. It restricts to stars with good velocity\r\n\n-- measurements through the v_errcode selection criteria.\r\n\n\r\n\nSELECT\r\n\n    TOP 100 v.mangaid, v.plate, v.ifudesign, v.mjd, v.ra, v.dec, v.heliov, v.verr, g.m_g, g.bprpc\r\n\nFROM mastar_goodvisits AS v\r\n\n    JOIN mastar_goodstars_xmatch_gaiaedr3 AS g ON g.mangaid = v.mangaid\r\n\nWHERE v.heliov > 300 AND v_errcode=0</div>\r\n\n            </a>\r\n\n            <a href="#" class="list-group-item rounded my-1 p-2" onclick="loadQuery(this)">\r\n\n                MaStar K-type dwarfs using colors\r\n\n                <div class="sample-query-text d-none">-- Search for K-type dwarfs using color criteria\r\n\n-- This query searches for K-type dwarfs using color cuts from SEGUE.\r\n\n-- Returns the gri magnitudes, plate ID and fiber bundle.\r\n\n-- Uses the mngtarg2 flag to select stars from the same photometry\r\n\n-- source catalog. Bit 8 is set for stars from the APASS system.\r\n\n--- Bit 11 is set for stars from the SDSS system. Both APASS and SDSS\r\n\n--- uses the SDSS filter bands.\r\n\n\r\n\nSELECT\r\n\n    TOP 100 mangaid, psfmag_2, psfmag_3, psfmag_4, plate, ifudesign, mjd, photocat\r\n\nFROM mastar_goodvisits\r\n\nWHERE\r\n\n    ( (mngtarg2 & POWER(2, 8)) <> 0 OR (mngtarg2 & POWER(2,11)) <>0 )\r\n\n     AND psfmag_3 BETWEEN 14.5 AND 19.0\r\n\n     AND (psfmag_2 - psfmag_3) BETWEEN 0.55 AND 0.75</div>\r\n\n            </a>\r\n\n            <a href="#" class="list-group-item rounded my-1 p-2" onclick="loadQuery(this)">\r\n\n                MaStar and Gaia info from stars near cluster ctr\r\n\n                <div class="sample-query-text d-none">-- Retrieve MaStar parameters and Gaia photomery for stars near cluster center\r\n\n-- This query joins the mastar_goodvisits_params and mastar_goodstars_xmatch_gaiaedr3 tables\r\n\n-- to retrieve the parameters, Gaia photometry (G-band magnitude and BP-RP color), \r\n\n-- and reddening estimates from a 3D dust map\r\n\n-- for stars within 0.5 degrees of the open cluster M67 (central coordinates 132.833, 11.82)\r\n\n\r\n\nSELECT\r\n\n    v.mangaid, v.plate, v.ifudesign, v.mjd, v.teff_med, v.logg_med, v.feh_med, v.alpha_med,\r\n\n    g.m_g, g.bp_rp, g.ebv, g.bprpc\r\n\nFROM mastar_goodvisits_params AS v\r\n\n    JOIN mastar_goodstars_xmatch_gaiaedr3 AS g ON g.mangaid = v.mangaid\r\n\nWHERE\r\n\n    POWER(v.ra - 132.83, 2) + POWER(v.dec - 11.82, 2) < POWER(0.5, 2)</div>\r\n\n            </a>\r\n\n        </div>\r\n\n    </div>\r\n\n</div>        </div>\r\n\n    </div>\r\n\n    <div class="row my-1">\r\n\n        <div class="col" id="queryResults" name="queryResults">\r\n\n            <div id="cmd_div">\r\n\n                <div class="sample-query-text d-none">\r\n\n                    SELECT TOP 5  \n\n  plate, mjd, fiberid  \n\nFROM specObj  \n\nWHERE ((PrimTarget & 64) > 0)  \n\n       AND (z > 0.000000) \n\n       AND (z <= 0.700000) \r\n\n                </div>\r\n\n            </div>\r\n\n            <div class="query-results">\r\n\n                \r\n\n            </div>\r\n\n        </div>\r\n\n    </div>\r\n\n</div>\r\n\n\r\n\n            </div>\r\n\n        </div>\r\n\n\r\n\n    </div>\r\n\n<footer class="navbar-fixed-bottom navbar-dark bg-blue text-semi-transparent ">\r\n\n    <div class="container main sci-footer">\r\n\n        <div class="row">\r\n\n\r\n\n            <div class="col my-1">\r\n\n                <ul class="nav navbar-nav">\r\n\n                    <li class="text-semi-transparent"><strong>Sponsored by:</strong></li>\r\n\n                    <li><a class="navbar-link" href="https://sloan.org/">Alfred P. Sloan Foundation</a></li>\r\n\n                    <li><a class="navbar-link" href="https://www.nsf.gov/">The National Science Foundation</a></li>\r\n\n                    <li class="text-semi-transparent"><a class="navbar-link" href="https://arc.apo.nmsu.edu/" target="_blank">ARC</a></li>\r\n\n                </ul>\r\n\n            </div>\r\n\n            <div class="col-md-1 my-1 d-none d-md-block">\r\n\n            </div>\r\n\n            <div class="col my-1">\r\n\n                <ul class="nav navbar-nav">\r\n\n                    <li class="text-semi-transparent"><strong>Policies:</strong></li>\r\n\n                    <li class="text-semi-transparent"><a class="navbar-link" href="http://skyserver.sdss.org/log/en/traffic/privacy.asp" target="_blank">Privacy Policy</a></li>\r\n\n                    <li class="text-semi-transparent"><a class="navbar-link" href="http://skyserver.sdss.org/log/en/traffic/" target="_blank">Website Traffic</a></li>\r\n\n                    \r\n\n                    \r\n\n                 </ul>\r\n\n            </div>\r\n\n            <div class="col my-1">\r\n\n                <ul class="nav navbar-nav">\r\n\n                    <li class="text-semi-transparent"><strong>Contact:</strong></li>\r\n\n                    <li class="text-semi-transparent">email: <a class="navbar-link" href="#">helpdesk@sdss.org</a></li>\r\n\n                </ul>\r\n\n            </div>\r\n\n        </div>\r\n\n    </div>\r\n\n</footer>\r\n\n   \r\n\n</body>\r\n\n</html>'

-------------------------------------------------------------------

Any help will be greatly appreciated!

The version of my astroML is 1.0.2.post1

Regards,
Li-Xin

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Bug: query_plate_mjd_fiber error in Chapter 1 #275

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Bug: query_plate_mjd_fiber error in Chapter 1 #275

Description

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions