pray-calc-ml/research/aggregate_d0_values.csv
Aric Camarata c1eeef53c4 Expand dataset to 5,871 Fajr / 46 Isha across 114 locations
Major additions:
- Extract all 1,621 Basthoni 2022 SQM records (46 Indonesian sites,
  Lampiran 2-5) via precomputed_angles.py
- Add 9 new raw sighting CSVs: Abdel-Hadi Malaysia, BRIN multistation,
  Kassim Bahali (2017+2019), Khalifa Saudi, Moonsighting.com,
  Shaukat 2015 Blackburn UK, Walisongo Sulawesi
- Curate aggregate D0 database (115 entries) in research/

Pipeline improvements:
- Open-Topo-Data SRTM30m primary elevation API with fallback
- APPROVED_RAW_CSVS allowlist prevents circular data ingestion
- Pre-computed angle merge path (bypasses back-calculation for SQM data)
- BAD_NOTE_MARKERS quality filter for excluded sources

Collection tools:
- BRIN multistation SQM processors
- PDF/HTML table extractor for academic papers
- Source tracking database (collection_manifest.json)

Documentation:
- Rewrite .wiki/Data.md and .wiki/Research.md from scratch
- Expand Data-Sources.md with full Basthoni Lampiran breakdown
- Add 14 researcher outreach drafts
- Update .gitignore to exclude bulk/experimental files
2026-02-28 10:51:01 -05:00

12 KiB

1sourcesitelatlngelevation_mprayerd0_angled0_stdn_nightsmethodsky_qualityyear_range
2MJC South Africa standardJohannesburg-26.228.041753fajr18.0standardn/acurrent
3Herdiwijaya 2016+2020Kupang Amfoang, NTT-9.6123.951300fajr18.083.0SQM/photometerpristine2011-2018
4Damanhuri & Mukarram LAPAN 2022Lombok, NTT-8.56116.125fajr16.51SQMrural2018
5Maskufa et al. 2024 MazahibLabuan Bajo, Flores NTT-8.5119.8910fajr19.3SQMpristine2023
6Setyanto et al. 2021 Al-HilalLabuan Bajo, NTT-8.39119.6810fajr19.131.0SQMpristine2018
7Herdiwijaya 2014-2016Yogyakarta-7.87110.42100fajr17.00.7136.0photometersuburban2014-2016
8Damanhuri & Mukarram LAPAN 2022Pasuruan, East Java-7.64112.94fajr16.51SQMsuburban2018
9Damanhuri & Mukarram LAPAN 2022Garut, West Java-7.21107.9717fajr16.51SQMrural2018
10Herdiwijaya 2016+2020Cimahi, West Java-6.88107.53700fajr18.5SQMsuburban2011-2018
11Damanhuri & Mukarram LAPAN 2022Sumedang, West Java-6.86107.92556fajr16.51SQMrural2018
12Herdiwijaya 2016+2020Bosscha Observatory, Lembang-6.83107.611300fajr15.383.0photometerrural2011-2018
13Setyanto et al. 2021 Al-HilalBosscha Observatory-6.83107.611300fajr16.071.0SQMrural2015
14Setyanto et al. 2021 Al-HilalImahnoong Observatory-6.83107.622200fajr15.261.0SQMrural2018
15Al-faruq 2013 UPI thesisBosscha Observatory (wet)-6.82107.621300fajr15.0photoelectricrural2012
16Al-faruq 2013 UPI thesisBosscha Observatory (dry)-6.82107.621300fajr16.0photoelectricrural2012
17Setyanto et al. 2021 Al-HilalSedan, Rembang-6.76111.5930fajr17.641.0SQMrural2018
18Saksono ISRN/UHAMKACirebon, West Java-6.72108.555fajr13.4SQMurban2015
19Noor & Hamdani 2018 QIJISTayu Beach, Pati, Central Java-6.68111.055fajr17.04.0photoelectric+SQMrural2016
20Maskufa et al. 2024 MazahibBogor, West Java-6.59106.79265fajr13.58SQMurban2023
21Saksono & Fulazzaky 2020 NRIAGDepok, West Java-6.38106.83150fajr14.00.626.0SQMurban2015
22Setyanto et al. 2021 Al-HilalMombhul Beach, Gresik-5.79112.735fajr19.151.0SQMpristine2018
23Hisbullah Salam 2022-2023 WalisongoBulukumba, South Sulawesi-5.56120.1810fajr18.24SOOF+SQMpristine2022-2023
24Hisbullah Salam 2022-2023 WalisongoTakalar, South Sulawesi-5.43119.4310fajr17.0SOOF+SQMsuburban2022-2023
25Saksono ISRN/UHAMKABalikpapan, East Kalimantan-1.27116.8310fajr13.4SQMurban2015
26Damanhuri & Mukarram LAPAN 2022Biak, Papua-1.17135.810fajr16.51SQMrural2018
27Saksono ISRN/UHAMKAPadang, West Sumatra-0.9100.355fajr13.4SQMurban2015
28Saksono ISRN/UHAMKAManokwari, West Papua-0.86134.0810fajr13.4SQMurban2015
29Saksono ISRN/UHAMKABatusangkar, West Sumatra-0.47100.6891fajr13.4SQMurban2015
30Damanhuri & Mukarram LAPAN 2022Agam, West Sumatra-0.25100.37850fajr16.51SQMrural2018
31Damanhuri & Mukarram LAPAN 2022Pontianak, West Kalimantan0.0109.331fajr16.51SQMsuburban2018
32Saksono ISRN/UHAMKABitung, North Sulawesi1.44125.1920fajr13.4SQMurban2015
33Damanhuri & Mukarram LAPAN 2022Manado, North Sulawesi1.49124.8580fajr16.51SQMsuburban2018
34Abdel-Hadi & Hassan 2022 IJAATeluk Kemang, N. Sembilan (Fajr)2.46101.8727fajr14.190.52SQMrural2007-2008
35Abdel-Hadi & Hassan 2022 IJAAPort Klang, Selangor (Fajr)3.0101.446fajr15.07SQMsuburban2007-2008
36Pinem et al. 2024 JMEASri Mersing Beach, N. Sumatra3.4599.05fajr14.0SQMsuburban2022
37Pinem et al. 2024 JMEAPondok Permai Beach, N. Sumatra3.4699.05fajr15.0SQMrural2022
38Lubis et al. 2025 Al-HisabOIF UMSU Medan3.698.6722fajr13.030.0SQMurban2024
39Abdel-Hadi & Hassan 2022 IJAAKuala Lipis, Pahang (Fajr)4.18102.0475fajr14.08SQMrural2007-2008
40Abdel-Hadi & Hassan 2022 IJAAMerang, Terengganu (Fajr)5.52102.9542fajr14.6SQMrural2007-2008
41Nigeria standardKano12.08.52472fajr18.0standardn/acurrent
42Taha et al. 2025 Emirates ScholarJeneifisa, Mauritania20.85-14.383170fajr14.85naked-eyepristine2024
43Taha et al. 2025 Emirates ScholarJorf, Mauritania20.25-15.28391fajr14.85naked-eyepristine2024
44Umm al-Qura standardMakkah, Saudi Arabia21.4239.83300fajr18.5standardn/acurrent
45Bangladesh IF estimateDhaka23.7290.418fajr15.0standardn/acurrent
46Hassan et al. 2014 NRIAGAswan24.0932.9115fajr14.7naked-eyerural1984-1987
47Taha et al. 2025 Emirates ScholarMadinah24.4739.61598fajr14.58SQM+CCDsuburban2024
48Taha et al. 2025 Emirates ScholarRiyadh25.76747.2540fajr14.580.313.0naked-eye+DSLRsuburban2024
49Pakistan standardKarachi24.8667.0110fajr15.0standardn/acurrent
50Hassan et al. 2020 multi-siteMarsa Alam25.0734.910fajr14.56multi-methodpristine2015-2019
51Hassan et al. 2020 multi-siteKharga Oasis25.4530.5580fajr14.56multi-methodpristine2015-2019
52Hassan et al. 2016 NRIAGAssiut27.1731.1870fajr13.4880.0SQMsuburban2015-2016
53Hassan et al. 2020 multi-siteHurghada27.2633.810fajr14.56multi-methodrural2015-2019
54Khalifa et al. 2018 NRIAGHail, Saudi Arabia27.5241.7980fajr14.0140.31732.0SQM+photoelectricpristine2014-2015
55Hassan et al. 2014 NRIAGBaharia Oasis28.3428.88150fajr14.7naked-eyepristine1984-1987
56Rashed et al. 2022 IJMETWadi al-Hitan, Fayum29.2830.0550fajr14.64.0SQM+naked-eyepristine2018-2019
57IAEME Fayum studyFayum, Egypt29.2830.0550fajr14.4multi-methodrural2015-2019
58Taha et al. 2025 Emirates Scholar15th of May City, Egypt29.9631.7650fajr12.69SQM+CCDurban2024
59Hassan et al. 2014 NRIAGKottamia Observatory (Fajr)30.0331.82477fajr14.7photoelectric+naked-eyerural1984-1987
60Semeida & Hassan 2018 BJBASWadi Al Natron (Fajr)30.530.10fajr14.538.0naked-eyepristine2016-2017
61Hassan et al. 2016 NRIAGSinai31.0732.9330fajr14.6680.0SQMrural2015-2016
62Hassan et al. 2020 multi-siteAlexandria31.229.910fajr14.56multi-methodsuburban2015-2019
63Hassan et al. 2014 NRIAGMatrouh (Fajr)31.3527.2430fajr13.5instrumentsrural1984-1987
64Abed 2015 Jordan JEast Sawaqah, Jordan31.3836.27700fajr19.52.0naked-eyepristine2009
65Morocco Habous standardMarrakech31.63-8.0467fajr18.0standardn/acurrent
66Abed 2015 Jordan JEast Uraynibah, Jordan31.6436.0700fajr19.57.0naked-eyepristine2009-2010
67Al-Hilal 2021 Tubruq LibyaTubruq, Libya32.0824.0110fajr13.481053.0naked-eyeruralmulti-year
68Diyanet Turkey 2012-2015Ankara, Turkey39.9332.85938fajr18.0unknownsuburban2012-2015
69Asim Yusuf 2017Exmoor, UK (Fajr)51.15-3.65300fajr16.0naked-eyepristine2014-2016
70Hizbul Ulama UK 1987-1989Blackburn, UK (Fajr)53.75-2.48120fajr15.021.0naked-eyesuburban1987-1989
71Basthoni 2022 PhD UIN WalisongoTilong Kupang, NTT-10.14123.73296fajr14.372.06213.0SQMsomewhat dark2018-2019
72Basthoni 2022 PhD UIN WalisongoBanyuwangi, East Java-8.028114.4251fajr19.880.5960.0SQMdark2020
73Basthoni 2022 PhD UIN WalisongoGarut, West Java-7.65107.69210fajr14.832.56101.0SQMdark2018
74Basthoni 2022 PhD UIN WalisongoPasuruan, East Java-7.567112.67457fajr13.891.4187.0SQMsomewhat bright2019
75Basthoni 2022 PhD UIN WalisongoBosscha Lembang, West Java-6.824107.6171289fajr13.691.86189.0SQMsomewhat bright2012
76Basthoni 2022 PhD UIN WalisongoMangkangkulon Semarang, Central Java-6.971110.2961fajr12.791.35154.0SQMbright/urban2019-2021
77Basthoni 2022 PhD UIN WalisongoSubang, West Java-6.562107.76990fajr12.681.4959.0SQMsomewhat bright2018
78Basthoni 2022 PhD UIN WalisongoDepok, West Java-6.39106.7686fajr13.640.5315.0SQMbright/urban2015
79Basthoni 2022 PhD UIN WalisongoKarimunjawa, Central Java-5.822110.4911fajr15.482.37252.0SQMdark2020-2021
80Basthoni 2022 PhD UIN WalisongoBiak, Papua-1.174136.10147fajr13.382.4148.0SQMsomewhat dark2019-2020
81Basthoni 2022 PhD UIN WalisongoAgam, West Sumatra-0.204100.32855fajr16.671.92151.0SQMdark2019
82Basthoni 2022 PhD UIN WalisongoPontianak, West Kalimantan-0.007109.3652fajr12.341.6476.0SQMsomewhat bright2018
83Basthoni 2022 PhD UIN WalisongoMedan, North Sumatra3.58298.72225fajr11.921.1728.0SQMbright/urban2019
84Basthoni 2022 PhD UIN WalisongoPaopao Gowa, South Sulawesi-5.184119.4714fajr14.011.1713.0SQMbright/urban2013
85Marzouk et al. 2025 AUASSKottamia Observatory, Egypt29.93231.825411fajr14.03.0naked-eye+camerarural2023-2024
86Marzouk et al. 2025 AUASSKharga Oasis, Egypt25.330.16740fajr14.52.0camerapristine2023-2024
87Marzouk et al. 2025 AUASSAswan, Egypt23.80332.492210fajr15.04.0camerarural2023-2024
88Marzouk et al. 2025 AUASSFayum, Egypt29.28330.0550fajr14.52.0CCD+camerarural2023-2024
89Kassim Bahali 2019 IJMETPekan, Pahang3.408103.3565fajr15.51.0DSLR+SQMrural2017
90Kassim Bahali 2019 IJMETDungun, Terengganu4.795103.4265fajr16.03.0DSLR+SQMrural2017
91Kassim Bahali 2019 IJMETSabang, Aceh5.87695.3395fajr16.55.0DSLR+SQMrural2017
92Faid et al. 2024 Sci. ReportsCoonabarabran, NSW Australia-31.25149.27860isha17.49SQMpristine2017-2022
93Herdiwijaya 2016+2020Kupang, NTT (dusk)-10.2123.650isha18.853photometerrural2011-2018
94Al-faruq 2013 UPI thesisBosscha Observatory (wet, Isha)-6.82107.621300isha14.0photoelectricrural2012
95Al-faruq 2013 UPI thesisBosscha Observatory (dry, Isha)-6.82107.621300isha15.0photoelectricrural2012
96Faid et al. 2024 Sci. ReportsTanjung Balau, Johor (rural)1.8104.45isha15.67SQMrural2017-2022
97Abdel-Hadi & Hassan 2022 IJAATeluk Kemang, N. Sembilan (Isha)2.46101.8727isha14.21SQMrural2007-2008
98Faid et al. 2024 Sci. ReportsPutrajaya (urban)2.9101.6820isha11.5SQMurban2017-2022
99Abdel-Hadi & Hassan 2022 IJAAPort Klang, Selangor (Isha)3.0101.446isha14.0SQMsuburban2007-2008
100Hamidi 2007-2008Port Klang, Selangor (Isha)3.0101.446isha16.5SQMsuburban2007-2008
101Abdel-Hadi & Hassan 2022 IJAAKuala Lumpur (Isha)3.15101.6860isha12.85SQMurban2007-2008
102Abdel-Hadi & Hassan 2022 IJAAKuala Lipis, Pahang (Isha)4.18102.0475isha14.380.91SQMrural2007-2008
103Hamidi 2007-2008Kuala Lipis, Pahang (Isha)4.18102.0475isha16.5SQMrural2007-2008
104Faid et al. 2024 Sci. ReportsPantai Batu Buruk, Terengganu5.32103.155isha15.67SQMrural2017-2022
105Faid et al. 2024 Sci. ReportsBalai Cerap Unisza, Terengganu5.4102.5820isha17.49SQMpristine2017-2022
106Faid et al. 2024 Sci. ReportsPantai Masjid TZ, Terengganu5.4103.955isha15.67SQMrural2017-2022
107Niri et al. 2012 MEJSRTanjung Aru, Kota Kinabalu5.95116.034isha18.0naked-eye+SQMrural2009
108Faid et al. 2024 Sci. ReportsPantai Mek Mas, Kelantan6.32102.155isha17.49SQMpristine2017-2022
109Faid et al. 2024 Sci. ReportsSimpang Mengayau, Sabah7.2116.510isha17.49SQMpristine2017-2022
110Khalifa et al. 2018 NRIAGHail, Saudi Arabia (Isha)27.5241.7980isha14.832.0SQM+photoelectricpristine2014-2015
111Hassan et al. 2014 NRIAGKottamia Observatory (Isha)30.0331.82477isha14.5photoelectric+naked-eyerural1984-1987
112Semeida & Hassan 2018 BJBASWadi Al Natron (Isha)30.530.10isha14.038.0naked-eyepristine2016-2017
113Hassan et al. 2014 NRIAGMatrouh (Isha)31.3527.2430isha14.0instrumentsrural1984-1987
114Asim Yusuf 2017Exmoor, UK (Isha)51.15-3.65300isha15.0naked-eyepristine2014-2016
115Hizbul Ulama UK 1987-1989Blackburn, UK (Isha)53.75-2.48120isha15.0naked-eyesuburban1987-1989