[teqc] helpful tip of week 2001

Lou Estey lou at unavco.org
Wed May 16 10:42:16 MDT 2018


This week's tip: qc: percentage of actual to expected complete observations

A typical qc SUM (summary) line from teqc might be (*)

[768] teqc +qcq tmp.obs
...
       first epoch    last epoch    hrs   dt  #expt  #have   %   mp1   mp2 o/slps
SUM 16  7  6 00:00 16  7  6 23:58 24.00 120  15978  15972 100  0.37  0.35  15972

The '#expt' is the excepted number of complete observations, assuming perfect data
collection at or above the qc elevation cutoff mask angle (which is set to 10 degrees
by default; see https://postal.unavco.org/pipermail/teqc/2017/002383.html) and
assuming a constant sampling interval (120 seconds, in this case).
The '#have' is the number of actual complete observations that were collected
at or above the qc elevation cutoff mask angle.   The '%' value is the ratio of these,
#have/#expt, to the nearest percent.  ("Complete observations" are explained in
last week's tip, https://postal.unavco.org/pipermail/teqc/2018/002475.html.)

The "expected number" of observations is only possible for those SVs with
ephemerides or, in teqc-speak, those being handled in qc 'full'; see
tip of the week https://postal.unavco.org/pipermail/teqc/2018/002474.html.

If you recall, we can "shut off" doing orbit calculations for one or more constellations
with the '-no_orb' option; see tip of the week https://postal.unavco.org/pipermail/teqc/2016/002115.html
For this sample data set, since we have ephemerides and data for six constellations
(i.e. all except IRNSS), let's try shutting off Beidou orbit calculations:

[769] teqc -no_orb C +qcq tmp.obs
...
       first epoch    last epoch    hrs   dt  #expt  #have   %   mp1   mp2 o/slps
SUM 16  7  6 00:00 16  7  6 23:58 24.00 120  15167  15161 100  0.37  0.35  15161

... or shutting off GLONASS orbit calculations:

[770] teqc -no_orb R +qcq tmp.obs
...
       first epoch    last epoch    hrs   dt  #expt  #have   %   mp1   mp2 o/slps
SUM 16  7  6 00:00 16  7  6 23:58 24.00 120  11183  11183 100  0.34  0.22  11183

Notice that the percentage of #have/#expt stays essentially the same, 100% (to the
nearest percent).  The same thing should happen if a subset of the ephemerides
for a constellation were missing and teqc does a qc 'lite' on the data for those SVs.

You should also get the same results if you filter out both the ephemerides and
the data for a constellation, for example (and compare with above):

[771] teqc -C +qcq tmp.obs
...
       first epoch    last epoch    hrs   dt  #expt  #have   %   mp1   mp2 o/slps
SUM 16  7  6 00:00 16  7  6 23:58 24.00 120  15167  15161 100  0.37  0.35  15161

[771] teqc -R +qcq tmp.obs
...
       first epoch    last epoch    hrs   dt  #expt  #have   %   mp1   mp2 o/slps
SUM 16  7  6 00:00 16  7  6 23:58 24.00 120  11183  11183 100  0.34  0.22  11183

Note: Keep in mind that doing '-no_orb C' vs. '-C' or '-no_orb R' vs. '-R' are
not the same even though the SUM lines here show the same results.  The options
'-C' or '-R' are entirely filtering out Beidou or GLONASS, respectively, (see tip
of the week https://postal.unavco.org/pipermail/teqc/2017/002277.html) whereas
the '-no_orb' options are only telling teqc not to perform orbit calculations for
the specified constellation(s); see tip of the week
https://postal.unavco.org/pipermail/teqc/2016/002115.html.

But the main tip this week is that the percentage from #have/#expt is a fairly resilient
quantity, especially if faced with incomplete sets of ephemerides for your GNSS data.

Happy teqc-ing!

cheers,
--lou

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Louis H. Estey, Ph.D.              office:  [+001] 303-381-7456
UNAVCO, 6350 Nautilus Drive           FAX:  [+001] 303-381-7451
Boulder, CO  80301-5554            e-mail:  lou  unavco.org

"If the universe is the answer, what is the question?"
                                                -- Leon Lederman
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

* This sample 24-hour data set has been decimated to 2-minute sampling, and has ephemerides
and observables from six constellations:

[765] teqc +mds tmp.obs
2016-07-06 00:00:00  2016-07-06 23:58:00   23.967 hr      4366148  tmp.obs

[766] ll tmp.*
-rw-r--r-- 1 lou dmg   42862 Jan 23 14:58 tmp.cmp
-rw-r--r-- 1 lou dmg  234363 Jan 23 14:58 tmp.gal
-rw-r--r-- 1 lou dmg  155183 Jan 23 14:58 tmp.glo
-rw-r--r-- 1 lou dmg  133947 Feb 12 19:41 tmp.gps
-rw-r--r-- 1 lou dmg 4366148 Jan 23 20:29 tmp.obs
-rw-r--r-- 1 lou dmg    3218 Jan 23 14:58 tmp.qzs
-rw-r--r-- 1 lou dmg  324783 Feb 13 16:09 tmp.sbs

[767] teqc -O.sum . tmp.obs
          L1    L2    L5    L6    L7    L8    C1    P1    C2    P2    C5    C6    C7    C8    S1    S2    S5    S6    S7    S8
         ----  ----  ----  ----  ----  ----  ----  ----  ----  ----  ----  ----  ----  ----  ----  ----  ----  ----  ----  ----
    G09   228   227   228     0     0     0   228   227   226   227   228     0     0     0   228   228   228     0     0     0
    G02   216   215     0     0     0     0   216   215     0   215     0     0     0     0   216   215     0     0     0     0
    G06   255   257   259     0     0     0   256   254   258   254   259     0     0     0   256   258   259     0     0     0
    G25   271   271   269     0     0     0   271   270   271   270   269     0     0     0   271   271   269     0     0     0
    G21   228   228     0     0     0     0   228   228     0   228     0     0     0     0   228   228     0     0     0     0
    G05   263   263     0     0     0     0   263   261   261   261     0     0     0     0   263   263     0     0     0     0
    G12   253   254     0     0     0     0   253   252   251   252     0     0     0     0   253   254     0     0     0     0
    G20   208   207     0     0     0     0   208   207     0   207     0     0     0     0   208   207     0     0     0     0
    G29   213   213     0     0     0     0   213   213   210   213     0     0     0     0   213   213     0     0     0     0
    G31   255   257     0     0     0     0   255   254   253   254     0     0     0     0   255   257     0     0     0     0
    G13   279   278     0     0     0     0   279   278     0   278     0     0     0     0   279   278     0     0     0     0
    G15   276   278     0     0     0     0   276   276   276   276     0     0     0     0   276   278     0     0     0     0
    G26   277   278   277     0     0     0   277   277   275   277   277     0     0     0   277   278   277     0     0     0
    G18   225   225     0     0     0     0   225   225     0   225     0     0     0     0   225   225     0     0     0     0
    G16   268   266     0     0     0     0   268   267     0   267     0     0     0     0   268   267     0     0     0     0
    G10   224   224   224     0     0     0   224   224   224   224   224     0     0     0   224   224   224     0     0     0
    G27   280   280   280     0     0     0   280   280   279   280   280     0     0     0   280   280   280     0     0     0
    G24   279   280   280     0     0     0   279   279   280   279   280     0     0     0   279   280   280     0     0     0
    G32   212   213   213     0     0     0   212   212   213   212   213     0     0     0   212   213   213     0     0     0
    G08   278   281   281     0     0     0   278   277   281   277   281     0     0     0   278   281   281     0     0     0
    G14   218   218     0     0     0     0   218   218     0   218     0     0     0     0   218   218     0     0     0     0
    G11   278   278     0     0     0     0   278   278     0   278     0     0     0     0   278   278     0     0     0     0
    G01   279   278   280     0     0     0   279   277   278   277   280     0     0     0   279   278   280     0     0     0
    G22   233   232     0     0     0     0   234   232     0   232     0     0     0     0   234   232     0     0     0     0
    G03   259   259   255     0     0     0   259   258   259   258   255     0     0     0   259   259   255     0     0     0
    G23   217   217     0     0     0     0   217   217     0   217     0     0     0     0   217   217     0     0     0     0
    G07   222   222     0     0     0     0   222   222   221   222     0     0     0     0   222   222     0     0     0     0
    G30   218   219   219     0     0     0   218   217   219   217   219     0     0     0   218   219   219     0     0     0
    G28   230   230     0     0     0     0   230   230     0   230     0     0     0     0   230   230     0     0     0     0
    G17   213   213     0     0     0     0   213   213   212   213     0     0     0     0   213   213     0     0     0     0
    G19   213   212     0     0     0     0   213   212     0   212     0     0     0     0   213   212     0     0     0     0
    R02   276   272     0     0     0     0   276     0   272     0     0     0     0     0   276   272     0     0     0     0
    R17   249   245     0     0     0     0   249     0   245     0     0     0     0     0   249   245     0     0     0     0
    R09   299   299     0     0     0     0   299     0   299     0     0     0     0     0   299   299     0     0     0     0
    R19   291   291     0     0     0     0   291     0   291     0     0     0     0     0   291   291     0     0     0     0
    R18   279   277     0     0     0     0   279     0   277     0     0     0     0     0   279   277     0     0     0     0
    R03   300   300     0     0     0     0   300     0   300     0     0     0     0     0   300   300     0     0     0     0
    R16   293   272     0     0     0     0   293     0   272     0     0     0     0     0   293   272     0     0     0     0
    R10   290   287     0     0     0     0   290     0   287     0     0     0     0     0   290   287     0     0     0     0
    R04   304   303     0     0     0     0   304     0   303     0     0     0     0     0   304   303     0     0     0     0
    R20   286   287     0     0     0     0   286     0   287     0     0     0     0     0   286   287     0     0     0     0
    R05   280   278     0     0     0     0   280     0   278     0     0     0     0     0   280   278     0     0     0     0
    R11   233   231     0     0     0     0   233     0   231     0     0     0     0     0   233   231     0     0     0     0
    R06   236   235     0     0     0     0   236     0   235     0     0     0     0     0   236   235     0     0     0     0
    R21   239   239     0     0     0     0   239     0   239     0     0     0     0     0   239   239     0     0     0     0
    R13   234   233     0     0     0     0   234     0   233     0     0     0     0     0   234   233     0     0     0     0
    R07   214   215     0     0     0     0   214     0   215     0     0     0     0     0   214   215     0     0     0     0
    R14   251   252     0     0     0     0   251     0   252     0     0     0     0     0   251   252     0     0     0     0
    R22   246   246     0     0     0     0   246     0   246     0     0     0     0     0   246   246     0     0     0     0
    R15   258   259     0     0     0     0   258     0   259     0     0     0     0     0   258   259     0     0     0     0
    R23   247   246     0     0     0     0   247     0   246     0     0     0     0     0   247   246     0     0     0     0
    R08   218   218     0     0     0     0   218     0   218     0     0     0     0     0   218   218     0     0     0     0
    R24   238   198     0     0     0     0   238     0   198     0     0     0     0     0   238   198     0     0     0     0
    R01   227   225     0     0     0     0   227     0   225     0     0     0     0     0   227   225     0     0     0     0
    S33   720     0   720     0     0     0   720     0     0     0   720     0     0     0   720     0   720     0     0     0
    S35   720     0   720     0     0     0   720     0     0     0   720     0     0     0   720     0   720     0     0     0
    S38   720     0   720     0     0     0   720     0     0     0   720     0     0     0   720     0   720     0     0     0
    E26   283     0   281   284   282   285   283     0     0     0   281   284   282   285   283     0   281   284   282   285
    E08   178     0   180   180   180   180   178     0     0     0   180   180   180   180   178     0   180   180   180   180
    E20   240     0     0     0     0     0   243     0     0     0     0     0     0     0   243     0     0     0     0     0
    E19   284     0   284   282   284   284   284     0     0     0   284   282   284   284   284     0   284   282   284   284
    E12   377     0   378   377   377   379   377     0     0     0   378   377   377   379   377     0   378   377   377   379
    E30   197     0   199   199   198   200   197     0     0     0   199   199   198   200   197     0   199   199   198   200
    E11   380     0   378   380   377   381   380     0     0     0   378   380   377   381   380     0   378   380   377   381
    E09   308     0   310   309   309   310   308     0     0     0   310   309   309   310   308     0   310   309   309   310
    E24   286     0   285   286   286   287   286     0     0     0   285   286   286   287   286     0   285   286   286   287
    E14   139     0   139   139   139   139   139     0     0     0   139   139   139   139   139     0   139   139   139   139
    E22   126     0   126   126   126   126   126     0     0     0   126   126   126   126   126     0   126   126   126   126
    C07    82     0     0    82    83     0    82     0     0     0     0    82    83     0    82     0     0    82    83     0
    C12   319     0     0   320   319     0   319     0     0     0     0   320   319     0   319     0     0   320   319     0
    C11   304     0     0   302   303     0   304     0     0     0     0   302   303     0   304     0     0   302   303     0
    C08   106     0     0   106   104     0   106     0     0     0     0   106   104     0   106     0     0   106   104     0
    C14   295     0     0   295   294     0   295     0     0     0     0   295   294     0   295     0     0   295   294     0
    C06    83     0     0    83    83     0    83     0     0     0     0    83    83     0    83     0     0    83    83     0
    J01    33    26    38     0     0     0    33     0    26     0    38     0     0     0    33    26    38     0     0     0

Past helpful tips:

week 1894: using teqc config files - https://postal.unavco.org/pipermail/teqc/2016/002067.html
week 1895: qc of high-rate data - https://postal.unavco.org/pipermail/teqc/2016/002071.html
week 1896: UNIX/Linux shells for Windows - https://postal.unavco.org/pipermail/teqc/2016/002072.html
week 1897: '-' vs. '+' teqc options - https://postal.unavco.org/pipermail/teqc/2016/002076.html
week 1898: auto-identification of formats - https://postal.unavco.org/pipermail/teqc/2016/002092.html
week 1899: auto-identification vs. format flags - https://postal.unavco.org/pipermail/teqc/2016/002096.html
week 1900: square brackets in options - https://postal.unavco.org/pipermail/teqc/2016/002105.html
week 1901: using option '+mds' - https://postal.unavco.org/pipermail/teqc/2016/002108.html
week 1902: qc results w/ problematic nav messages - https://postal.unavco.org/pipermail/teqc/2016/002113.html
week 1903: '-no_orb[it]' and '-no_pos[ition]' options - https://postal.unavco.org/pipermail/teqc/2016/002115.html
week 1904: '-week' option - https://postal.unavco.org/pipermail/teqc/2016/002117.html
week 1905: using '+bcf' for XYZ/geodetic conversion - https://postal.unavco.org/pipermail/teqc/2016/002126.html
week 1906: the '+v[erify]' option - https://postal.unavco.org/pipermail/teqc/2016/002128.html
week 1907: '+C2', '+L5', "+L6', '+L7', '+L8', '+all' options - https://postal.unavco.org/pipermail/teqc/2016/002130.html
week 1908: getting RINEX doppler and L2 - https://postal.unavco.org/pipermail/teqc/2016/002131.html
week 1909: using paths w/ file names - https://postal.unavco.org/pipermail/teqc/2016/002132.html
week 1910: the (un)importance of file names - https://postal.unavco.org/pipermail/teqc/2016/002133.html
week 1911: notices, warnings, and errors - https://postal.unavco.org/pipermail/teqc/2016/002134.html
week 1912: the '-max_rx_SVs' option - https://postal.unavco.org/pipermail/teqc/2016/002137.html
week 1913: the end of '++igs' and '+igs' - https://postal.unavco.org/pipermail/teqc/2016/002140.html
week 1914: splicing together RINEX files - https://postal.unavco.org/pipermail/teqc/2016/002144.html
week 1915: using '-O.int' and '-O.dec' - https://postal.unavco.org/pipermail/teqc/2016/002145.html
week 1916: '+doy' option - https://postal.unavco.org/pipermail/teqc/2016/002146.html
week 1917: '-tbin' and '-ast' options - https://postal.unavco.org/pipermail/teqc/2016/002152.html
week 1918: mp12 RMS before/after Oct 2013 - https://postal.unavco.org/pipermail/teqc/2016/002158.html
week 1919: the global windowing options - https://postal.unavco.org/pipermail/teqc/2016/002159.html
week 1920: '-M.dec' and '-N.dec' options - https://postal.unavco.org/pipermail/teqc/2016/002163.html
week 1921: combining time filtering options - https://postal.unavco.org/pipermail/teqc/2016/002176.html
week 1922: helping me (or someone else on the list) help you - https://postal.unavco.org/pipermail/teqc/2016/002187.html
week 1923: the "build" line - https://postal.unavco.org/pipermail/teqc/2016/002190.html
week 1924: the qc '-w[idth]' option - https://postal.unavco.org/pipermail/teqc/2016/002193.html
week 1925: qc with explicit time windowing - https://postal.unavco.org/pipermail/teqc/2016/002194.html
week 1926: the '+rx_state' option - https://postal.unavco.org/pipermail/teqc/2016/002200.html
week 1927: the '-O.sum' option - https://postal.unavco.org/pipermail/teqc/2016/002204.html
week 1928: the '+meta' and '+mds' options - https://postal.unavco.org/pipermail/teqc/2016/002206.html
week 1930: more on '-O.sum' - https://postal.unavco.org/pipermail/teqc/2017/002207.html
week 1931: the '-O.s[ystem]' option - https://postal.unavco.org/pipermail/teqc/2017/002208.html
week 1932: leap seconds - https://postal.unavco.org/pipermail/teqc/2017/002215.html
week 1936: what you can (and shouldn't) do in a RINEX obs file - https://postal.unavco.org/pipermail/teqc/2017/002229.html
week 1938: the '+psp' option - https://postal.unavco.org/pipermail/teqc/2017/002231.html
week 1939: the '+diag' option - https://postal.unavco.org/pipermail/teqc/2017/002235.html
week 1951: '-n_<system>' and SV filtering options - https://postal.unavco.org/pipermail/teqc/2017/002277.html
week 1953: more with '+diag' option - https://postal.unavco.org/pipermail/teqc/2017/002287.html
week 1954: using '+diag' output to split raw files - https://postal.unavco.org/pipermail/teqc/2017/002290.html
week 1955: current qc notation - https://postal.unavco.org/pipermail/teqc/2017/002302.html
week 1956: the '+qcq' option - https://postal.unavco.org/pipermail/teqc/2017/002304.html
week 1957: using Trimble formats - https://postal.unavco.org/pipermail/teqc/2017/002305.html
week 1958: ToC != ToE messages - https://postal.unavco.org/pipermail/teqc/2017/002310.html
week 1959: receivers vs. formats - https://postal.unavco.org/pipermail/teqc/2017/002311.html
week 1960: when the '-week' option is very wrong to use - https://postal.unavco.org/pipermail/teqc/2017/002314.html
week 1961: "less" is usually best - https://postal.unavco.org/pipermail/teqc/2017/002315.html
week 1962: using GPS L2C with teqc - https://postal.unavco.org/pipermail/teqc/2017/002316.html
week 1964: the '+eds' options - https://postal.unavco.org/pipermail/teqc/2017/002317.html
week 1965: handling RINEX comment lines - https://postal.unavco.org/pipermail/teqc/2017/002324.html
week 1966: the '+dUTC_p' options - https://postal.unavco.org/pipermail/teqc/2017/002331.html
week 1967: the strange position from '+meta' - https://postal.unavco.org/pipermail/teqc/2017/002355.html
week 1972: what shows up as metadata in RINEX headers - https://postal.unavco.org/pipermail/teqc/2017/002362.html
week 1973: GPS L2C navigation messages - https://postal.unavco.org/pipermail/teqc/2017/002363.html
week 1974: the '+ion_p' options - https://postal.unavco.org/pipermail/teqc/2017/002370.html
week 1975: the '+event' options - https://postal.unavco.org/pipermail/teqc/2017/002372.html
week 1976: options '+smtt' (default) vs. '-smtt' - https://postal.unavco.org/pipermail/teqc/2017/002374.html
week 1977: the reported interval with '+meta' for a RINEX obs file - https://postal.unavco.org/pipermail/teqc/2017/002377.html
week 1978: the '-N.dUTC' options - https://postal.unavco.org/pipermail/teqc/2017/002378.html
week 1979: the various qc elevation angles - https://postal.unavco.org/pipermail/teqc/2017/002383.html
week 1980: avoid in RINEX: Transit data - https://postal.unavco.org/pipermail/teqc/2017/002385.html
week 1981: avoid in RINEX: epoch flag = 6 - https://postal.unavco.org/pipermail/teqc/2017/002389.html
week 1982: avoid in RINEX: RCV CLOCK OFFS APPL = 1 - https://postal.unavco.org/pipermail/teqc/2018/002392.html
week 1983: don't count on in RINEX: receiver clock offset per epoch - https://postal.unavco.org/pipermail/teqc/2018/002393.html
week 1984: requirements for multiple target files/stdin - https://postal.unavco.org/pipermail/teqc/2018/002410.html
week 1985: default output for various input - https://postal.unavco.org/pipermail/teqc/2018/002412.html
week 1986: the '+latency' options - https://postal.unavco.org/pipermail/teqc/2018/002419.html
week 1987: the 'O.px and 'O.pg' options - https://postal.unavco.org/pipermail/teqc/2018/002422.html
week 1988: the '+relax' option - https://postal.unavco.org/pipermail/teqc/2018/002423.html
week 1992: the '+x_tilt' options - https://postal.unavco.org/pipermail/teqc/2018/002452.html
week 1993: GLONASS: slot and freq. chnl. numbers - https://postal.unavco.org/pipermail/teqc/2018/002453.html
week 1994: GLONASS: slot numbers > 24 - https://postal.unavco.org/pipermail/teqc/2018/002454.html
week 1995: GLONASS: signals - https://postal.unavco.org/pipermail/teqc/2018/002456.html
week 1996: GLONASS: broadcast ephemeris - https://postal.unavco.org/pipermail/teqc/2018/002457.html
week 1997: GLONASS: system time and broadcast time parameters - https://postal.unavco.org/pipermail/teqc/2018/002458.html
week 1998: qc: 'lite' vs. 'full' - https://postal.unavco.org/pipermail/teqc/2018/002470.html
week 1999: qc: the 'full' point-position and the antenna 'height' - https://postal.unavco.org/pipermail/teqc/2018/002474.html
week 2000: qc: what's a "complete observation"? - https://postal.unavco.org/pipermail/teqc/2018/002475.html

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://postal.unavco.org/pipermail/teqc/attachments/20180516/c77118cf/attachment-0001.html>


More information about the teqc mailing list