tag:blogger.com,1999:blog-33958831440479313112024-03-13T06:00:40.678+00:00TlatetRidding the world of grumpy old mengom1http://www.blogger.com/profile/07201321705941282416noreply@blogger.comBlogger744125tag:blogger.com,1999:blog-3395883144047931311.post-11510559939302424082019-11-10T15:45:00.004+00:002019-11-10T15:51:21.026+00:00AVR<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgF8kxkfeDx0VP85Qtv6lNHNT5EkG_82ylgUWzdoxK8I3R5lkRCSreEnW0WhJii9DKa1kSRnwVyxu0Sk2SvGPAyxeNKItRsLWQoPvYSQuPuqxHLiv5U7v1yctVvLq4yQ2i_KrGsf7H4eotL/s1600/49043528962_f7b844b1df_c.jpg" imageanchor="1" style="clear: left; float: left; margin-bottom: 1em; margin-right: 1em;"><img border="0" data-original-height="600" data-original-width="800" height="240" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgF8kxkfeDx0VP85Qtv6lNHNT5EkG_82ylgUWzdoxK8I3R5lkRCSreEnW0WhJii9DKa1kSRnwVyxu0Sk2SvGPAyxeNKItRsLWQoPvYSQuPuqxHLiv5U7v1yctVvLq4yQ2i_KrGsf7H4eotL/s320/49043528962_f7b844b1df_c.jpg" width="320" /></a></div>
<span class="css-901oao css-16my406 r-1qd0xha r-ad9z0x r-bcqeeo r-qvutc0">Alnwick has been the only town in Northumberland without a connection to the National Cycle Network, so the opening of an off-road cycle path along the Aln Valley Railway is an important step forward. </span><br />
<br />
<span class="css-901oao css-16my406 r-1qd0xha r-ad9z0x r-bcqeeo r-qvutc0">A short ride, and today was cold, but a lovely afternoon to try it out.</span><br />
<br />
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiP4cIWKMZqJ6IE80wI1ObstpOLsUwsTw9v6vMjpogVW7kTU0HwoGVSjYRtuEusNgcPmm5jfu0DNoNa2yNJ-KM5CFVR9Eo953-tLH4eYVWInbg1Ix_2YwSdekSh3RuJZuq8_q4zW_VeQVb9/s1600/49043528957_13fa0013f6_c.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="600" data-original-width="800" height="240" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiP4cIWKMZqJ6IE80wI1ObstpOLsUwsTw9v6vMjpogVW7kTU0HwoGVSjYRtuEusNgcPmm5jfu0DNoNa2yNJ-KM5CFVR9Eo953-tLH4eYVWInbg1Ix_2YwSdekSh3RuJZuq8_q4zW_VeQVb9/s320/49043528957_13fa0013f6_c.jpg" width="320" /></a></div>
<br />
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjKm86efwGeAtPXAt08vzY5J5OVPabk5Zafea5cQpilzZS-2-cSDekQUfA32asDmXGi-eK-OS4xHxMRDACFRgC_NXU2sidc3hj310Fvq0E7_U0FX7TaSoMsTran35-9xgiZXemgh49SP8Me/s1600/49042812313_08a3c0cb9b_c.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="600" data-original-width="800" height="240" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjKm86efwGeAtPXAt08vzY5J5OVPabk5Zafea5cQpilzZS-2-cSDekQUfA32asDmXGi-eK-OS4xHxMRDACFRgC_NXU2sidc3hj310Fvq0E7_U0FX7TaSoMsTran35-9xgiZXemgh49SP8Me/s320/49042812313_08a3c0cb9b_c.jpg" width="320" /></a></div>
gom1http://www.blogger.com/profile/07201321705941282416noreply@blogger.com0tag:blogger.com,1999:blog-3395883144047931311.post-54705005103878598572019-10-08T19:58:00.000+01:002019-10-09T10:17:09.927+01:00Kielder<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiPusIoon7fjCd598qFuVBTpYR8j2WVjri8jKXjKBXtRICw9NHrrG85AmvD8RNwWuzB0QfEqId6mQbHKmLP3b9pv25MTLdmTiE1iwyMMoksNVAM5cK9yN1lCx8JFzcKamDHPUaI9wiLmM-Q/s1600/48866629287_fe6d7c2704_c.jpg" imageanchor="1" style="clear: right; float: right; margin-bottom: 1em; margin-left: 1em;"><img border="0" data-original-height="533" data-original-width="800" height="213" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiPusIoon7fjCd598qFuVBTpYR8j2WVjri8jKXjKBXtRICw9NHrrG85AmvD8RNwWuzB0QfEqId6mQbHKmLP3b9pv25MTLdmTiE1iwyMMoksNVAM5cK9yN1lCx8JFzcKamDHPUaI9wiLmM-Q/s320/48866629287_fe6d7c2704_c.jpg" width="320" /></a></div>
Earlier this week I rode from a few miles outside Bellingham, to the Kielder dam, and Falstone. My route touched on parts of NCN10 (Reivers Cycle Route). It was a good choice: beautiful scenery and demanding enough (for me) to feel I had stretched myself, without overdoing things.<br />
<br />
Today the plan was to complete a circuit of Kielder Water using the Waterside Path. That's a recreational route for walkers and cyclists. We've had heavy rain, and there were a few muddy patches, but on the whole it's well-paved with fine gravel. I was expecting a ride of about 26 miles: something that would stretch me again, without being unrealistic.<br />
<br />
It was a good plan, but things didn't turn out that way. I started from the dam, working anti-clockwise along the north shore towards Kielder village. So far so good - it's a lovely ride, and although there was a blustery wind, most of the trail is sheltered by trees. Showers threatened, but didn't arrive. <br />
<br />
Then, two-thirds of the way along the north shore I had a puncture. It shouldn't have been a problem - I carry a spare inner tube, and a repair kit. However, I haven't had to repair a puncture in the last ten years, and I made a mess of it. Somehow I managed to wreck the valve on the spare tube, and although I found and fixed a couple of holes in the old tube it still wouldn't hold air. I couldn't work out why.<br />
<br />
I had no choice other than pushing the remaining distance to Kielder, where the wonderful people at the <a href="https://www.thebikeplace.co.uk/" target="_blank">Bike Stop</a> helped me out. By then I was running late, and getting tired. I was expected back by now, and there was no mobile signal, so it was difficult to share what was going on. So I chose the main road along the south of the reservoir to finish the loop and return to the dam.<br />
<br />
The end result: I completed a circuit of the reservoir and covered 22 miles. However, my idea of a circling the reservoir along the waterside will have to wait for another day. It's a lovely route, so maybe that's not such a bad thing.gom1http://www.blogger.com/profile/07201321705941282416noreply@blogger.com0tag:blogger.com,1999:blog-3395883144047931311.post-15787544575374974702019-10-01T19:11:00.001+01:002019-10-01T19:11:16.481+01:00Today's rideTwenty-one miles today, following NCN1 south to Druridge bay. Very pleasant, but nothing remarkable. The water in the Aln Estuary was unusally high, but not high enough to reach the cycle path.gom1http://www.blogger.com/profile/07201321705941282416noreply@blogger.com0tag:blogger.com,1999:blog-3395883144047931311.post-32998194686007816182019-09-21T11:03:00.005+01:002019-09-21T11:08:58.672+01:00Useful advice<div style="text-align: center;">
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEi7ryPiK61ohq32LpwcJ-VNeFtMvOKafdBr7LmLyhW3raebxTzHEFkUL3yLb6WO1-NWKxh7P8hJl8mu8zs8GDfByhT85y9nPdpjmZ_bxVrlxhO78OXQpoLa14NKVZ1ksN1Ier7Dj0K_TwNq/s1600/DSCF7218.JPG" imageanchor="1" style="clear: right; float: right; margin-bottom: 1em; margin-left: 1em;"><img border="0" data-original-height="1600" data-original-width="1066" height="320" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEi7ryPiK61ohq32LpwcJ-VNeFtMvOKafdBr7LmLyhW3raebxTzHEFkUL3yLb6WO1-NWKxh7P8hJl8mu8zs8GDfByhT85y9nPdpjmZ_bxVrlxhO78OXQpoLa14NKVZ1ksN1Ier7Dj0K_TwNq/s320/DSCF7218.JPG" width="213" /></a></div>
<i>"If you are trying to save weight in your luggage, don't forget that you can always cut the covers off the maps."</i></div>
<br />
From the CTC route guide to cycling in Britan and Ireland, by Christa Gausden and Nicholas Crane (1980)gom1http://www.blogger.com/profile/07201321705941282416noreply@blogger.com0tag:blogger.com,1999:blog-3395883144047931311.post-34398082328841156982019-09-08T19:51:00.000+01:002019-09-09T10:21:06.788+01:00Private stations<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEj6Gb1CuDZzp3yjTfddTl-YvpRC8pgKu0keV3wHAxLZz7pRzVU_0khJhYDBgSVksu09ZCCt5ffgvAJvIi-dOqsthnLv7bD1Mqq_-m6M2zmuiXtiy80Bdje4w_7Jgt86NPpEC1UnwhsDLAlF/s1600/48700103243_19b59f2b12_z.jpg" imageanchor="1" style="clear: right; float: right; margin-bottom: 1em; margin-left: 1em;"><img border="0" data-original-height="480" data-original-width="640" height="240" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEj6Gb1CuDZzp3yjTfddTl-YvpRC8pgKu0keV3wHAxLZz7pRzVU_0khJhYDBgSVksu09ZCCt5ffgvAJvIi-dOqsthnLv7bD1Mqq_-m6M2zmuiXtiy80Bdje4w_7Jgt86NPpEC1UnwhsDLAlF/s320/48700103243_19b59f2b12_z.jpg" width="320" /></a></div>
The Newcastle to Berwick Railway opened in 1847, but plans were being prepared from 1839. The proposed route crossed land owned by Earl Grey, who had been Prime Minister but was now retired. He and his son fought to protect their estates from the arrival of the railway.<br />
<br />
Parliament was sympathetic to projects that could demonstrate public benefit, so the landowners' efforts did not succeed, and the planned route from Newcastle to Berwick now forms part of today's East Coast Main Line. However, the Howicks ended up with private stations: one at Little Mill to serve Howick Hall, and one to serve Fallodon Hall at Fallodon. Little Mill went on to become a public station by 1861, and was finally closed in 1965. Fallodon remained a private station until it was closed in1934.<br />
<br />
There is more detail than most visitors will want on Fallodon <<a href="http://disused-stations.org.uk/f/fallodon/index.shtml" target="_blank">here</a>> and on Little Mill <<a href="http://disused-stations.org.uk/l/little_mill/index.shtml" target="_blank">here</a>>.<br />
<br />
Today there is virtually no evidence that there was once a station at either of these locations. Nevertheless, I persuaded myself that "<i>Private Stations between Alnmouth and Berwick</i>" was a decent theme for a ride. I ended up covering 21 miles (which bumps my average ride up a bit). The route was quiet, pretty and within my capabilities. The weather was almost ideal. And as an added bonus some of the villages I passed through had put out coloured bicycles to encourage me along. I suspect they will be leaving them in place for tomorrow's <a href="https://www.northumberland.gov.uk/Tour-of-Britain-2019/Stage3.aspx" target="_blank">Tour of Britain</a> gom1http://www.blogger.com/profile/07201321705941282416noreply@blogger.com0tag:blogger.com,1999:blog-3395883144047931311.post-28163938453716078882019-09-03T20:46:00.002+01:002019-09-04T09:02:33.932+01:00Tyne crossings<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhvMnDnBQXJRx4YVtwr5rGM8s5Fadng8_-hwluLzmqQ95MpnG8eYguDBQ17_hlGBtt3wbr_gzMszNSLkEFZTh2jealh18KMYBqwX_HNakVCIn2atTPCaATxroyAUTCaT0G7YheN7MrBjbM6/s1600/48672782447_10bf28072c_z.jpg" imageanchor="1" style="clear: right; float: right; margin-bottom: 1em; margin-left: 1em;"><img border="0" data-original-height="640" data-original-width="426" height="320" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhvMnDnBQXJRx4YVtwr5rGM8s5Fadng8_-hwluLzmqQ95MpnG8eYguDBQ17_hlGBtt3wbr_gzMszNSLkEFZTh2jealh18KMYBqwX_HNakVCIn2atTPCaATxroyAUTCaT0G7YheN7MrBjbM6/s320/48672782447_10bf28072c_z.jpg" width="213" /></a></div>
Newcastle is famous for the bridges, but there are other ways to cross the Tyne. Here's a list, displayed outside the Tyne Pedestrian Tunnel at Wallsend.<br />
<br />
Today I cycled three of these crossings. My main objective was to ride through the Cyclist's Tunnel. That crossing has just been re-opened to connect Jarrow and Wallsend. The other two that I rode were the Millenium Bridge between Gateshead and Newcastle and the ferry between North Shields and South Shields.<br />
<br />
Connecting these crossings are NCN72 (Hadrian's Cycleway) along the North Bank of the Tyne, and NCN14 along the South Bank (South Tyne Cycleway and part of C2C) . I haven't ridden on NCN14 before, and the last time I rode along this part of NCN72 was over ten years ago (May 2009). At that time the demolition of the Swann Hunter shipyard was under way, and I was struck by the contrast between that significant symbol of industrial decline and other, more positive, signs of investment in new housing, new factories, and new offices.<br />
<br />
Because it follows the banks of a major river the route is fairly flat. The engineers seem to have capitalised well on past industrial infrastructure, and subsequent development. So much of the route is traffic free, and all of it seems to be well-used. The signage for the tunnel hasn't quite caught up with developments yet, I had a bit of trouble finding the the ferry pier in South Shields, and I missed a coupe of signs hidden behind greenery. But in general the route is very easy to follow. I passed at least <strike>two</strike> three cycle workshops, and there are a few nice refreshment stops (though these are concentrated in relatively few places). There was more graffiti, litter, flytipping and over-grown greenery than I expected.<br />
<br />
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiN6moadhSJ976Bmv5ELPYKvxYQh74Nc8MgW9RZG_sF7H4PgUpQpn-rtns9blzkAUujQZ40iIhaX4l9c4VwflAHQcNcmCeCiv-vyt1Tch9rOlyTTLTPRChU_wGV54BtUkv4JISp0Ci-EEcb/s1600/48672611031_c5e0effb7b_k.jpg" imageanchor="1" style="clear: left; float: left; margin-bottom: 1em; margin-right: 1em;"><img border="0" data-original-height="1066" data-original-width="1600" height="213" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiN6moadhSJ976Bmv5ELPYKvxYQh74Nc8MgW9RZG_sF7H4PgUpQpn-rtns9blzkAUujQZ40iIhaX4l9c4VwflAHQcNcmCeCiv-vyt1Tch9rOlyTTLTPRChU_wGV54BtUkv4JISp0Ci-EEcb/s320/48672611031_c5e0effb7b_k.jpg" width="320" /></a></div>
If pretty scenery appeals then you had better look elsewhere. This is a route with a complex history, and some striking contrasts. Today, in a ride of 32 miles, I've seen a wide variety of commercial, industrial and residential areas. Not to mention Segedunum Roman Fort and Museum (at the end of Hadrian's Wall); and the remains of a monastery that was once one of Europe’s most influential centres of learning and home to the Venerable Bede. And several different ways of crossing the Tyne. So not pretty, but plenty to reflect on.<br />
<br />
<a href="https://www.openstreetmap.org/#map=13/54.9752/-1.5623&layers=C">https://www.openstreetmap.org/#map=13/54.9752/-1.5623&layers=C</a><br />
<a href="https://www.openstreetmap.org/#map=13/54.9752/-1.5623&layers=C" target="_blank"><br /></a>
<br />gom1http://www.blogger.com/profile/07201321705941282416noreply@blogger.com0tag:blogger.com,1999:blog-3395883144047931311.post-8344249181853675292019-08-22T18:56:00.004+01:002019-08-22T18:59:13.335+01:00Whittingham to Netherton<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiJWZs9DH4dXwKFqzr_1ioH42K0U0NpL-W1g-LRoe6lPh6oEMV7oc6wqNGYXe6Rxneapb9YlvZUnPfeICHRS-qUhM5dRSFgZd6f-0sNMzjBvML73aNnrPYIX9gb3STIvLsw5BohK0HFdSIc/s1600/WhiitinghamNetherton.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="872" data-original-width="1600" height="174" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiJWZs9DH4dXwKFqzr_1ioH42K0U0NpL-W1g-LRoe6lPh6oEMV7oc6wqNGYXe6Rxneapb9YlvZUnPfeICHRS-qUhM5dRSFgZd6f-0sNMzjBvML73aNnrPYIX9gb3STIvLsw5BohK0HFdSIc/s320/WhiitinghamNetherton.png" width="320" /></a></div>
I covered sixteen miles this afternoon, crawling westwards up the Aln Valley from Whittingham to Netherton, then flying back via Alnham (where the River Aln begins). <br />
<br />
It was a gentle climb out, with a steady headwind pushing against me. As I set off a local warned "<i>There's rain coming down the valley</i>". There was indeed, but until I reached Netherton it just threatened. Drizzle started as I turned back.<br />
<br />
On the way back I was confident about my route. Over-confident, because I didn't check the map at a key junction. That muddled things a bit. Nevertheless the gentle descent, aided by a tail wind, meant that things went a lot more quickly. <br />
<br />
Unco-operative weather: but that didn't detract from the scenery at the head of the Aln Valley. The County Council has been out surfacing minor roads. Some of these were still pock-marked and covered in loose gravel, but others are now lovely and smooth. All were wonderfully quiet: I passed a post van, a couple of tractors, a lorry and about half-a-dozen cars. gom1http://www.blogger.com/profile/07201321705941282416noreply@blogger.com0tag:blogger.com,1999:blog-3395883144047931311.post-12112308663742915352019-08-18T21:34:00.000+01:002019-08-18T22:48:41.584+01:00Rock onAfter over-reaching myself on Thursday I covered an unambitious eighteen miles today. It was a minor variation on my standard loop. There were a couple of light showers, a blustery wind, and heavier traffic than usual for back roads on a Sunday afternoon. Nothing remarkable though: all went well, and various numbers have shifted slightly in the right direction.gom1http://www.blogger.com/profile/07201321705941282416noreply@blogger.com0tag:blogger.com,1999:blog-3395883144047931311.post-1050072045796141482019-08-16T16:16:00.002+01:002019-08-17T23:50:03.310+01:00Yesterday I rode to Scotland<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhBtl1dSf-ZHQyLWKO7PlsJ74gkHgu55W0UUP5PmKP_AyLWOQUKugzTvJjExVtbNR0hBcpOC1Yi53CME6UHNgT8wGqsa4JMwqMDGbbXO2jf63d-Lttw-kKdIWKXnk4zZU9LCEGWRINcmldu/s1600/48545568287_b7fbcf34f5_z.jpg" imageanchor="1" style="clear: right; float: right; margin-bottom: 1em; margin-left: 1em;"><img border="0" data-original-height="640" data-original-width="426" height="320" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhBtl1dSf-ZHQyLWKO7PlsJ74gkHgu55W0UUP5PmKP_AyLWOQUKugzTvJjExVtbNR0hBcpOC1Yi53CME6UHNgT8wGqsa4JMwqMDGbbXO2jf63d-Lttw-kKdIWKXnk4zZU9LCEGWRINcmldu/s320/48545568287_b7fbcf34f5_z.jpg" width="213" /></a></div>
Yesterday I rode to Scotland. That's not as impressive as it sounds, because I started from Etal. However, on a round trip of more than 30 miles, I reached the marvellous <a href="http://www.unionbridgefriends.com/" target="_blank">Union Chain Bridge</a>, and rode across to pay a ceremonial visit.<br />
<br />
From Etal I first headed east, beyond Bowsden to Lowick Mill. A strong following wind helped me up the climb. Then I turned north towards Ancroft. There followed a long stretch into a strong headwind, which wasn't a lot of fun. Then the drop down into Horncliffe and the River Tweed went more easily.<br />
<br />
By now I was running late and getting tired. I skipped a planned stop at the Honey Farm, and when I reached Norham I called home to say that my return would be later than intended. The scenery was lovely on the final leg south to Etal - but it was hard work.<br />
<br />
In summary, I've discovered (nicked) a great route for a fitter cyclist. It's almost entirely on quiet rural back-roads. There's very little traffic. The rolling landscape makes for variety, and offers some terrific distant views. There are memorable highlights at the Union Bridge across the River Tweed, at Norham Castle, the path along the banks of the River Till near Etal, and at Etal itself. Yesterday a strong wind didn't help, but I've learned an important lesson about my own limitations: I hit them at less than 30 miles. For now. gom1http://www.blogger.com/profile/07201321705941282416noreply@blogger.com0tag:blogger.com,1999:blog-3395883144047931311.post-70051328636570869352019-08-13T19:43:00.000+01:002019-08-13T19:45:38.113+01:00...and this is where I turned back<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgIk7UT3dD9nkVYCWqq0B4uB6WoeusexmboMWmHFOMDR69dTstZLqMfv88sVOZAQjhnCrm4q4sWuRvRVh4IGlDkU3AyPPYKdaHqAO7Dvnn99SpM_3ynaL8Y4GnBTQnGKpfiPn7KP5AA9WGq/s1600/48529365747_2576d0a91a_z.jpg" imageanchor="1" style="clear: right; float: right; margin-bottom: 1em; margin-left: 1em;"><img border="0" data-original-height="480" data-original-width="640" height="240" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgIk7UT3dD9nkVYCWqq0B4uB6WoeusexmboMWmHFOMDR69dTstZLqMfv88sVOZAQjhnCrm4q4sWuRvRVh4IGlDkU3AyPPYKdaHqAO7Dvnn99SpM_3ynaL8Y4GnBTQnGKpfiPn7KP5AA9WGq/s320/48529365747_2576d0a91a_z.jpg" width="320" /></a></div>
Weather and various commitments have kept me away from the bike for a couple of weeks. I had some ideas for an adventurous return, but it seemed more important to get back into a routine. So I ended up picking a familiar route. What made the outing special was the mix of people I met.<br />
<br />
I suspect the break in the rain contributed to a good number of cheerful cyclists, joggers, and walkers. In addition a group of young lads wanted me to stop so that they could show off their cycling tricks; a couple of police teased me for chickening out of riding through the flood; and a mother leaped to rescue her child's buggy, as it trundled towards the harbour edge (she had forgotten to put the brake on).<br />
<br />
Bottling the flood meant that I turned back slightly earlier than I had intended, so at the other end I overshot a bit, to make up the planned 14 miles.gom1http://www.blogger.com/profile/07201321705941282416noreply@blogger.com0tag:blogger.com,1999:blog-3395883144047931311.post-76909169446235536552019-07-28T19:37:00.001+01:002019-07-28T19:37:04.278+01:00Nothing remarkableToday I covered a smidgeon short of 18 miles (imperial), or about 28 kilometres (metric). I tried a couple of minor tweaks to my standard circuit. One avoids a hilly bit of road and the other just offers a change of scenery. With a drop in temperature and no wind to speak of, my average speed was slightly better than last time. Nothing remarkable, but quite satisfying.gom1http://www.blogger.com/profile/07201321705941282416noreply@blogger.com0tag:blogger.com,1999:blog-3395883144047931311.post-49623751542499074452019-07-21T23:13:00.000+01:002019-07-21T23:24:51.972+01:00Small beginningsToday's ride was 21 miles out beyond Embleton (with a following wind), and back (with a head wind). That's the end of two months back on the bike. I've had sixteen outings. My average ride has risen to almost 14 miles for a total distance of 222 miles. My Eddington number is currently 11. It's a start.gom1http://www.blogger.com/profile/07201321705941282416noreply@blogger.com0tag:blogger.com,1999:blog-3395883144047931311.post-338325976976599392019-07-16T21:16:00.001+01:002019-07-16T21:27:29.072+01:00River Till<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhjmWke6bTSE5S0g96_Ey1uuXF01Hbm1WGsWp6lR6UmN8tCwfFFd4_WHJ93cMree-PENwITVecr_VxNYctdZEWWiTk1DeEEkMRnUVU1BhVuXGm969PHUGci6c0RL-H-K7E_5NhGIQYnlqrh/s1600/RiverTillNCN68.png" imageanchor="1" style="clear: right; float: right; margin-bottom: 1em; margin-left: 1em;"><img border="0" data-original-height="1298" data-original-width="885" height="320" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhjmWke6bTSE5S0g96_Ey1uuXF01Hbm1WGsWp6lR6UmN8tCwfFFd4_WHJ93cMree-PENwITVecr_VxNYctdZEWWiTk1DeEEkMRnUVU1BhVuXGm969PHUGci6c0RL-H-K7E_5NhGIQYnlqrh/s320/RiverTillNCN68.png" width="218" /></a>The plan today was to stick the bike on the back of the car, and try part of NCN68 a bit further north than the section that I rode a few weeks ago. However, as I drove north the sky went dark and there was a heavy shower of rain. Instead of stopping near Ford, and getting soaked as I worked north, I thought it better to carry on driving until the rain stopped, then work south.<br />
<br />
The rain had pretty much stopped by the time I reached Norham. From there I followed NCN68 south, to Etal then back. It was a nice ride, with a particularly lovely section following the bank of the River Till.<br />
<br />
In a few days time I'll complete my first two months back on the bike.
Fourteen miles today takes the total distance past 200 miles. That doesn't sound much, but the air was humid and the landscape crinkly enough to make it feel like more. And the extended journey meant that I got home later than I planned, but as content as I hoped (and I didn't get soaked).gom1http://www.blogger.com/profile/07201321705941282416noreply@blogger.com0tag:blogger.com,1999:blog-3395883144047931311.post-36262996362049224642019-07-14T20:02:00.003+01:002019-07-14T20:04:57.360+01:00Littlemill limekilns<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhoF_KP-Sakf6G_IeS03xVp81S_m62bI7T3a_1dLpwKAoTlTIYQwu0KobSHZuRaPHEFQtEJcXmtBl57k0aKYz_QiulBp55O4mmY4b3-g96v3M2A25mT1f39qbzWTUaIARnEH_AWi3HZY64S/s1600/48283115926_2841dff8a0_k.jpg" imageanchor="1" style="clear: right; float: right; margin-bottom: 1em; margin-left: 1em;"><img border="0" data-original-height="1066" data-original-width="1600" height="213" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhoF_KP-Sakf6G_IeS03xVp81S_m62bI7T3a_1dLpwKAoTlTIYQwu0KobSHZuRaPHEFQtEJcXmtBl57k0aKYz_QiulBp55O4mmY4b3-g96v3M2A25mT1f39qbzWTUaIARnEH_AWi3HZY64S/s320/48283115926_2841dff8a0_k.jpg" width="320" /></a></div>
A pleasant ride today, passing this massive structure on the way to Embleton. This is one of the largest 19th century limekilns in the country. They built it next to the railway, so that lime could be loaded directly from the kiln onto wagons, and it remained in service for about a century - until shortly after World War II.<br />
<br />
As I settle into this loop as a fairly regular ride it seems to be getting easier. Is that because it's becoming more familiar, or because I'm getting stronger? I have no idea, but it was a pleasant afternoon, and another seventeen miles bumped my Eddington number for 2019 up by one. gom1http://www.blogger.com/profile/07201321705941282416noreply@blogger.com0tag:blogger.com,1999:blog-3395883144047931311.post-45696317131311321042019-06-30T20:23:00.001+01:002019-06-30T22:58:49.242+01:00Breamish Valley<a data-flickr-embed="true" href="https://www.flickr.com/photos/petereed/48162199512/in/datetaken/" style="clear: left; float: left; margin-bottom: 1em; margin-right: 1em;" title="Breamish Valley"><img alt="Breamish Valley" src="https://live.staticflickr.com/65535/48162199512_2a976fe438_n.jpg" /></a><script async="" charset="utf-8" src="//embedr.flickr.com/assets/client-code.js"></script>This beatiful valley <span class="st">in the Northumberland National Park is </span>crossed by NCN68.<br />
I'm out of practice, so the gentle climb up the valley against a steady headwind was hard work.<br />
But the return felt like flying. gom1http://www.blogger.com/profile/07201321705941282416noreply@blogger.com0tag:blogger.com,1999:blog-3395883144047931311.post-14578378073811408292019-06-27T13:25:00.002+01:002019-06-27T13:29:46.298+01:00I haven't posted anything on cycling for over seven years.<a data-flickr-embed="true" href="https://www.flickr.com/photos/petereed/47849108932/in/datetaken/" style="clear: right; float: right; margin-bottom: 1em; margin-left: 1em;" title="NCN-1"><img alt="NCN-1" height="500" src="https://live.staticflickr.com/65535/47849108932_c980272396.jpg" width="375" /></a><script async="" charset="utf-8" src="//embedr.flickr.com/assets/client-code.js"></script>I have now.gom1http://www.blogger.com/profile/07201321705941282416noreply@blogger.com0tag:blogger.com,1999:blog-3395883144047931311.post-18771964039875822472015-09-25T11:39:00.001+01:002015-09-26T16:40:41.688+01:00Lidar dataI'm not sure what it is going to be used for, but the Lidar data recently opened up by the Environment Agency is remarkable. Here's central Alnwick, hillshaded in QGIS, using 1m DSM elevations downloaded from <a href="http://environment.data.gov.uk/ds/survey#/download?grid=NU11">here</a>.<br />
<br />
<br />
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjV3BLY0nZrZodwYy2BHDuQxUIS7JrjgbTGZOWFwE05Ajm4FS5KtLvV8RgPSJqn-6lHlyK5AGwWM7Maa1UXEeot6rJdYgGx-BuV1uE2wlggdjAliM4BSHMHipTWTiQb6yIRxPQOZHHcEetA/s1600/AlnwickCentreShade.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="226" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjV3BLY0nZrZodwYy2BHDuQxUIS7JrjgbTGZOWFwE05Ajm4FS5KtLvV8RgPSJqn-6lHlyK5AGwWM7Maa1UXEeot6rJdYgGx-BuV1uE2wlggdjAliM4BSHMHipTWTiQb6yIRxPQOZHHcEetA/s320/AlnwickCentreShade.png" width="320" /></a></div>
<div class="separator" style="clear: both; text-align: center;">
<br /></div>
<br />
<hr />
Edited: 26/9/2015<br />
<br />
Thanks to Chris for the comment and pointers.<br />
<br />
There's more.<br />
<br />
If sea levels continue rising at 3.2mm p.a. Alnwick will look like this by 20,000 a.d. Thankfully our local pub will still be above the waves.<br />
<br />
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjyZUT5kH-RV88ql8Dw09wR1bXavZfGWlcD8bg6Bf5ETA_p58G5BeLeMxkN9UxKcdZhbtgoYUK2ooi3OTVIJPFYui5cyLpefpVU_tHRFmixCSDRXXdGXM37dOgPCxtO7zIUgJPSXZ3tlxkQ/s1600/AlnwickFlooded.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="235" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjyZUT5kH-RV88ql8Dw09wR1bXavZfGWlcD8bg6Bf5ETA_p58G5BeLeMxkN9UxKcdZhbtgoYUK2ooi3OTVIJPFYui5cyLpefpVU_tHRFmixCSDRXXdGXM37dOgPCxtO7zIUgJPSXZ3tlxkQ/s320/AlnwickFlooded.png" width="320" /></a></div>
<br />
And this is what I reckon the duke can see from the top of Alnwick Castle.<br />
<br />
<div class="separator" style="clear: both; text-align: center;">
</div>
<br />
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjsJIhtXJSlFsXgP5oeK-5co8GsCtVzFC_XqQYEdiflEXXpTIn7EL6WZLy1klSgJai3cfnrMbYG2_36NfFiyGYMl03d4V5BpBIBvJpIvRdwbP1v1dHymeUbyMY2Q4nBfSCJWkMUIQc2wJcI/s1600/AlnwickDukeViewShed.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="287" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjsJIhtXJSlFsXgP5oeK-5co8GsCtVzFC_XqQYEdiflEXXpTIn7EL6WZLy1klSgJai3cfnrMbYG2_36NfFiyGYMl03d4V5BpBIBvJpIvRdwbP1v1dHymeUbyMY2Q4nBfSCJWkMUIQc2wJcI/s320/AlnwickDukeViewShed.png" width="320" /></a></div>
<br />
<br />gom1http://www.blogger.com/profile/07201321705941282416noreply@blogger.com0tag:blogger.com,1999:blog-3395883144047931311.post-52009932608451334602015-08-23T09:26:00.001+01:002015-08-23T10:19:32.991+01:00OSM retail survey: Conclusions-2This picks up from previous posts to consider more specifically what tools might help contributors.<br />
<br />
The examples are rudimentary – stuff I've assembled for my own use, rather than robust tools for the wider community. If they have any value I hope it will be as prototypes for something more polished.<br />
<br />
<h3>
Missing data</h3>
<br />
There are about 385,000 retail properties in England that are missing from OSM, and the obvious way to help contributors is to point out where they are.<br />
<br />
To help achieve the most rapid improvement across the whole country I have tried to find dense retail concentrations that haven't been thoroughly mapped yet.<br />
<br />
<br />
<ul>
<li><a href="http://www.reedhome.org.uk/Documents/osmembed.html?kml=http://www.reedhome.org.uk/Documents/KML/lsoaplausibility.kml">http://www.reedhome.org.uk/Documents/osmembed.html?kml=http://www.reedhome.org.uk/Documents/KML/lsoaplausibility.kml</a></li>
</ul>
<br />
These are the biggest concentrations of unmapped retail property in England and Wales: about 1,000 of them, each with an average of 100 missing retail outlets across an area of under 2 sq. km.<br />
<br />
I've used a mix of Food Hygiene Data, Non-Domestic Rates, population data, and various other statistics to identify concentrations of retail outlets at a local level. I've done this for England and Wales. The same basic technique should work in Scotland because similar data is available, but the structure of the census geography, and data on non-domestic rates for Scotland is quite different, so the process needs tweaking, and I haven't got round to that yet.<br />
<br />
My formula for estimating the number of retail premises at a local level can probably be improved, but it will never be perfect. At this stage I don't think it is good enough to reliably identify areas that are almost complete, because that needs more precision. But I think it is good enough to flag up areas that are far from complete. Contributors who are looking for significant concentrations of missing retail outlets should be able to do a quick check on the area. If it still looks empty on the map, they can head there with a reasonable expectation of adding enough new retail outlets to make the trip worthwhile.<br />
<br />
Feedback based on local knowledge would be welcome, to help refine this a bit more.<br />
<br />
Helping contributors to find nearby concentrations of missing retail outlets is one way to quickly increase the overall volume of data. A different starting point is to assume that thorough retail coverage in some areas has a higher value to data users than adding missing shops elsewhere. On that basis we may want to encourage contributors to concentrate first on mapping areas which we think have the highest potential value.<br />
<br />
<br />
<ul>
<li><a href="http://www.reedhome.org.uk/Documents/osmembed.html?kml=http://www.reedhome.org.uk/Documents/KML/settlementplausibility.kml">http://www.reedhome.org.uk/Documents/osmembed.html?kml=http://www.reedhome.org.uk/Documents/KML/settlementplausibility.kml</a></li>
</ul>
<br />
<br />
This example picks out a limited number of smaller towns and cities where OSM data might have high value (e.g. to students or visitors).<br />
<br />
Areas coloured:<br />
<ul>
<li>blue already contain more than 75% of my estimated number of retail outlets</li>
<li>green contain 50-75% of my estimated number of retail outlets</li>
<li>orange contain 25-50% of my estimated number of retail outlets</li>
<li>red contain less than 25% of my estimated number of retail outlets </li>
</ul>
<br />
Each area is intended to cover a manageable size: one where a few contributors should quickly be able to bring retail content up to an impressive level. Larger cities are excluded on the basis that they justify a more systematic approach. My list is bit arbitrary – it is intended to cover a mix of different towns of roughly similar size, distributed across the country. Are these really the areas where OSM retail data is likely to have most value? I doubt it, but that might be a useful discussion point in its own right. For each suggestion of a settlement that should be added, please feel free to suggest one that should be removed.<br />
<br />
I can only assess how useful these estimates might be in areas that I know fairly well. Feedback on any unexpected results would be useful: to better understand where the technique can be improved.<br />
<br />
<h3>
Feedback to contributors</h3>
<br />
All contributors deserve to see the results of their work. But not all retail information is rendered on the standard map. And in my view it never can (and shouldn't) be. So to encourage contributors I would like to see a decent alternative to the standard map which shows more complete retail information. When I want to check specific content of the database I use either a data extract, Overpass, or the “Map Data” overlay on the standard map view. I'm happy to do this, but for many contributors (and particularly for novices) none of these techniques are particularly user-friendly. I suspect this is beyond my own technical capabilities, but there are examples (based on various data extracts) that illustrate the kind of thing that can be done.<br />
<br />
<ul>
<li><a href="http://openpoimap.org/">http://openpoimap.org/</a></li>
<li><a href="http://mijndev.openstreetmap.nl/~peewee32/paard/ruiterpadenOSM.html">http://mijndev.openstreetmap.nl/~peewee32/paard/ruiterpadenOSM.html</a></li>
</ul>
<br />
<h3>
Data collection</h3>
<br />
When mapping retail areas there will normally be some shops already recorded in OSM, which need checking. Alongside other existing features such as road junctions, these also provide reference points for adding new data. When surveying retail premises, it's handy to have a crib sheet to hand, on which to collect notes of any changes, which shows the current state of the data. This needs to show every relevant feature in the database, including some which won't be rendered on the standard map.<br />
<br />
Below is an example generated (automagically, with some rather clunky SQL) from OSM data for Winchester High Street (the pedestrian part). It starts at the western (top) end.<br />
<br />
<ul>
<li><a href="https://drive.google.com/file/d/0BzQeJ_0Y8XDfVG5KbWI1MXA5ZWs/view?usp=sharing">https://drive.google.com/file/d/0BzQeJ_0Y8XDfVG5KbWI1MXA5ZWs/view?usp=sharing</a></li>
</ul>
<br />
<br />
I've set this up to collect any shops, amenities and offices within 25 metres of the highway centre line, and display them in order. This simplistic approach only exhibits the most basic information, and includes more features than I would really want: including shops beyond each end of the central line, up side streets, and occasionally from a nearby street running parallel. But it's easy enough to cross out any unnecessary entries. To allow for some additions there's an additional spacer inserted every 20 metres (roughly twice the width of a conventional shop front). I find sheets like this speed up the data collection process and make it easier to add notes.<br />
<br />
<h3>
Consistency checks</h3>
<br />
I hope I've made a clear case that across most of the UK adding missing retail data is a higher priority than cleaning up tagging inconsistencies. However, this isn't true everywhere, and pointers to inconsistencies could help contributors to clean local data.<br />
<br />
Some basic consistency checks are easily carried on Overpass:<br />
<br />
<br />
<ul>
<li>amenity=pharmacy & dispensing=no: <a href="http://overpass-turbo.eu/s/aEc">http://overpass-turbo.eu/s/aEc</a></li>
<li>shop=cafe: <a href="http://overpass-turbo.eu/s/aEg">http://overpass-turbo.eu/s/aEg</a></li>
<li>name=Argos and shop not = catalogue: <a href="http://overpass-turbo.eu/s/aEW">http://overpass-turbo.eu/s/aEW</a></li>
<li>shop=fast_food: <a href="http://overpass-turbo.eu/s/aEV">http://overpass-turbo.eu/s/aEV</a></li>
<li>amenity=optician: <a href="http://overpass-turbo.eu/s/aEl">http://overpass-turbo.eu/s/aEl</a></li>
<li>shop=supermarket without building tag: <a href="http://overpass-turbo.eu/s/aEp">http://overpass-turbo.eu/s/aEp</a></li>
<li>shop=unknown: <a href="http://overpass-turbo.eu/s/aEr">http://overpass-turbo.eu/s/aEr</a></li>
<li>some basic spelling mistakes (shop tag includes upper case or space): <a href="http://overpass-turbo.eu/s/aEs">http://overpass-turbo.eu/s/aEs</a></li>
</ul>
<br />
But this isn't ideal for finding all quirky data within a local area, and finding more complex inconsistencies sometimes involves extensive processing that isn't really practical interactively. Overpass isn't the ideal solution here, but it is possible to do more crunching on a data extract. Here are some examples. Unlike Overpass, anything here that is fixed won't be quickly updated in the overlay (some of these quirks are already fixed, which could get annoying). Note that, for the sake of simplicity, this overlay only contains some of the features in the UK that exhibit these quirks.<br />
<br />
<ul>
<li><a href="http://www.reedhome.org.uk/Documents/osmembed.html?kml=http://www.reedhome.org.uk/Documents/KML/retailquirks.kml">http://www.reedhome.org.uk/Documents/osmembed.html?kml=http://www.reedhome.org.uk/Documents/KML/retailquirks.kml</a></li>
</ul>
<br />
<div>
<br /></div>
gom1http://www.blogger.com/profile/07201321705941282416noreply@blogger.com0tag:blogger.com,1999:blog-3395883144047931311.post-60089174776083042152015-08-12T10:29:00.003+01:002015-08-13T17:13:34.675+01:00OSM Retail Survey: Conclusions-1OSM has thrived by bringing together a community with diverse interests, and aligning their efforts behind a common purpose. In thinking how best to improve retail coverage it seems useful to consider how different groups with different interests and different skills will be able to contribute.<br />
<br />
The most obvious question for the community is how the existing tools might be improved. But I am not going to start there. Instead I will begin with how contributors might view the priorities - because that will determine which tools will be of greatest help.<br />
<br />
My starting point is based on findings from the survey:<br />
<ul>
<li>In a some localised areas retail data in OSM is the most comprehensive retail data that is generally available. Because OSM data has a degree of structure it should be capable of supporting certain types of structured search that are extremely difficult to achieve in any other way. These are the areas where the data will be of greatest value to end users and hence of greatest interest to application providers</li>
<li>We are still a long way from being able to offer comprehensive retail data across the whole of the UK. In the foreseeable future this means that most viable applications based on OSM data are likely to have a local focus, rather than aiming for national coverage. So far only a few areas have been really thoroughly mapped. One priority is to increase the number of thoroughly mapped areas.</li>
<li>Elsewhere, whatever issues data users find with the consistency and accuracy of UK retail data in OSM, the impact of those issues is small in comparison to the amount of retail data that is missing from OSM. Another priority is to reduce the volume of missing retail data.</li>
</ul>
To address missing data, I assume the community needs to expand the number of contributors, as well as encouraging existing contributors to add more basic retail data. We need to ensure that the process of collecting and contributing data is both satisfying and productive.<br />
<br />
Most contributors have only a limited choice of where to map. The question we need to help them with is <b>how </b>to make the biggest impact in their local area. Some contributors have more choice of where they map. The question we need to help them with is <b>where </b>they can make the biggest impact.<br />
<br />
If OSM is going to provide a decent platform for viable applications based on retail data, then the priority is to bring more areas of the UK up to a standard that compares with the best. OSM data doesn't have to be complete in order to be the best available source of retail data in a well-defined area: but it should be getting near complete. In towns and smaller cities individual contributors can quickly make an impact, by bringing retail data up to a good standard across a well-defined area. In an ideal world they might chose a location that would most interest potential application providers – perhaps a university town, or a city that attracts a large number of visitors.<br />
<br />
I'd like to think that contributors who want to improve retail data will start by assessing how retail coverage currently stands in their chosen area. For a rough idea, they can examine the standard map, or for more precision they can compare the number of shops in the OSM database with an estimate of how many there should be. There are various ways to get that estimate, but that's a separate question which I'll defer for now.<br />
<ul>
<li>If local coverage is currently under 25%, then this part of the map is still close to being a blank canvas. OSM data is far from providing the best source of retail data, and there will still be gaps in some of the most commonly mapped features, such as post-offices and pubs. The first priority is to make a start, develop technique, and demonstrate progress to encourage others. For a contributor's own motivation, they should begin with whatever interests them personally. This probably includes retail outlets that they are familiar with (i.e. ones that their family, friends and neighbours use regularly). Beyond that, major retail premises, such as supermarkets, banks and larger high street stores are relatively easy to tag, and are all properly rendered on the standard map. Their relatively large scale helps to build visibility. To help raise awareness add any retailers with a high public profile. This could include any well-known local specialists, those who advertise heavily, those who regularly feature in the local paper, or take an active part in the local chamber of trade.</li>
<li>If local coverage is around 25-50% then a fair number of shops will appear on the standard map, but there will still be plenty that are missing. Quite often some retail categories will have been well covered (pubs often seem to appear first), while others still have to be added. The priority now is to build momentum. The quickest results will be achieved in densely occupied retail zones such as the central shopping area and larger retail parks. Complete coverage is still some way off, and trying to include everything at this stage will slow things down. It is more important to include major outlets, and a representative sample of outlets that are of high public utility, and widespread interest. It seems to me that this should include retailers that cater for a broad section of the population – both their daily needs (convenience stores, post offices, pharmacies, take-aways, cafés, pubs), and more significant purchases (electrical goods, clothing, furniture, etc.). Others will have better insight into those catering for specific groups of customer (visitors, students, etc.), and in some towns these groups will be particularly important.</li>
<li>Once local coverage reaches around 50-75% then OSM data is providing some of the most complete retail data that is generally available. The standard map will contain a good number of shops – particularly in the town centre. But anyone familiar with the area will still find it fairly easy to spot shops that are missing. Particularly outside the main shopping areas there will be shops scattered across residential and commercial areas that haven't been added. Now is the time for contributors to work towards something approaching complete coverage. Missing shops are likely to be the more specialised, smaller and more quirky independent retailers, shops outside the central retail core, in suburban shopping parades, and corner shops in residential areas.</li>
<li>Over 75% coverage means that locally OSM is capable of providing some of the most comprehensive retail data that is generally available. Contributors will find it increasingly time-consuming to deal with the remaining gaps, and the more difficult categories are the most likely to have been left aside. Now is the time to include them. This is also the time to verify that existing data is up to date and consistent. There will be opportunities to add value with information that will be of use to different types of data user. This might include features such as wheelchair access, ATMs, non-standard opening times, specialist services, etc. Beyond this, contributors have choice. They can continue to add unreasonable levels of detail, that will never be used. Or better, broaden the scope of their survey into neighbouring towns and villages.</li>
</ul>
<br />
If this is broadly how things work, then I'd suggest the following priorities to help contributors:<br />
<br />
<ul>
<li>Firstly, contributors are encouraged by seeing the results of their work. Currently the standard map is the main source of such feedback, but it doesn't show all retail outlets, and it doesn't render all retail characteristics that contributors add. It is unrealistic to expect the standard map to render everything, so I'd like to see a different way of showing contributors the results of their work: one that doesn't depend on adding increasing detail to the standard map.</li>
<li>Secondly, for areas where retail data is relatively thin, contributors who have some choice of where to map may benefit from guidance on where and how they can make the biggest impact. Tools that highlight areas where there is a substantial amount of missing retail data could save them time. Suggesting areas where retail data could be of high utility may influence their choice of where to map.</li>
<li>Thirdly, retail data generally has to be collected by survey, and there is a lot missing. Tools that help contributors collect data in the field (i.e. on the high street) will make the process more satisfying and help to speed the process</li>
<li>And finally, once retail data in an area is relatively complete, the emphasis will change from improving coverage to improving consistency and adding value. Bulk edits won't help much, but tools that highlight inconsistencies and quirks in retail data will help contributors identify issues and improve quality.</li>
</ul>
gom1http://www.blogger.com/profile/07201321705941282416noreply@blogger.com0tag:blogger.com,1999:blog-3395883144047931311.post-80286022955548135602015-08-02T11:51:00.003+01:002015-08-02T11:51:50.372+01:00OSM Retail Survey: Part: 12aRetail outlets in OSM are represented in different ways.<br />
<br />
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEicBf4tjybv8QghjzjDAeZOFXu_zGkJ1BPfFzgkcRjfZr7jxCsRk5iNION_Sl9M7kVM0qll8RkozBjPt2AfwyADEAeGiIC9gaHdyaQIbKKyr5pxM3LGban4gOFi1ZxFC1ZjhD-wRQ516atz/s1600/retailrepresentation.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="181" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEicBf4tjybv8QghjzjDAeZOFXu_zGkJ1BPfFzgkcRjfZr7jxCsRk5iNION_Sl9M7kVM0qll8RkozBjPt2AfwyADEAeGiIC9gaHdyaQIbKKyr5pxM3LGban4gOFi1ZxFC1ZjhD-wRQ516atz/s320/retailrepresentation.png" width="320" /></a></div>
<br />
<br />
Very few shops have been added as a relation. Around two-thirds are a node, and one-third an area (almost always a closed way, occasionally as a relation between multiple ways).<br />
<br />
Larger types of outlet (supermarkets, motor trade outlets, petrol station, furniture showrooms, etc.) are more likely to be recorded as an area (with around 50% in that form); while smaller outlets such as post-offices, and pharmacies more likely to be recorded as a node (around 85% in that form).<br />
<br />
In effect, about a third of retail features are represented only by their location. In around two-thirds of cases there is more information on the geometry. The most common ways of representing the geometry of a retail outlet are<br />
<br />
<ul>
<li>as an area which represents both a shop and a building</li>
<li>as a node or area that represents a shop, and lies within an area that represents a building</li>
</ul>
<br />
These two cases are equally common in the data. In the real world, some shops are always going to be closely associated with a specific building, while others are always going to be perceived as a facility that happens to be located within a particular building. So it is reasonable to expect data users to find both of these approaches acceptable.<br />
<br />
Tagging indicates that almost all (87%) of areas that have been marked as a retail outlet are equivalent to a building footprint - i.e. they hold both a "shop" tag and a "building" tag. Among the remainder, some areas are tagged to represent landuse, and a few represent road surface, but most others carry no indication of what physical feature the area represents (i.e. no relevant tag added alongside “shop” or some type of “amenity”). The proportion of contributors who have used an area to represent landuse varies by the type of retail. In the case of petrol stations, for example, it is 3%, and in the case of garden centres it is almost 25%.<br />
<br />
When a retail outlet is drawn as a closed area, with a “shop” tag, but no other indication of what that area represents, it is most likely that the area is intended to represent a building. A random check suggests that this is what contributors normally intended, but renders cannot be certain, so the most likely outcome for retail features mapped as an area, without a “building” or “landuse” tag is that these features will not be rendered at all.<br />
<br />
Where landuse is specified on a retail area it is normally “retail” (76% of cases). Of the other generic urban landuse terms, “commercial” represents 16%. The remainder are mostly more specific terms such as “landuse=plant_nursery”.<br />
<br />
Of the retail outlets that do not have their own area defined, and are represented only by a node, just under half are contained within a (separately defined) building. In most cases (75%) the type of building is not defined further (“building=yes”), and in 10% the building is described as a retail building.<br />
<br />
There are a couple of thousand retail buildings containing at least one shop. The biggest clusters of retail nodes within such buildings represent individual outlets within large shopping centres (e.g. the St James Centre in Edinburgh). However, these only account for a small proportion of the total. Most buildings that contain shops only show a single shop node, and it is common for a single building to contain only a few retail outlets.<br />
<br />
In around 20% of cases, the retail node within a building is the only retail feature within that building. It might be assumed in this case that a single shop occupies the whole building, but renderers cannot be certain whether there are other, unmapped shops within the same building. Their only safe option is to render both building and shop, and place the node in the position marked.<br />
Although we can safely assume that almost all retail outlets should exist within a building, something over a third of all retail outlets in the database have no representation of a building associated with them. This is an indication of areas where building data is likely to be incomplete, but the information is of little value otherwise.<br />
<br />
Some large retail outlets are made up of numerous different components: petrol stations and garden centres are common examples. For petrol stations there is relatively clear guidance on how the various components should be mapped. Guidance is less comprehensive when it comes to garden centres.<br />
<br />
I've found 3,772 examples of “amenity=fuel” in the UK data, of which 70% are mapped as nodes, and 30% are areas. To map a service station as a node is simply to indicate the location. To map it as an area suggests that the contributor is at least aiming to provide more detailed visual information for rendering. Adding further detail on the products and services available, and detailed mapping of routes through the forecourt suggest that the contributor is aiming to support more sophisticated applications for more demanding users. To function properly, viable applications that can handle such complexity will require some consistency in the way that petrol stations are described.<br />
<br />
My interpretation of the mapping guidance for petrol stations is that:<br />
<br />
<ul>
<li>the building in the forecourt should be tagged as “amenity=fuel”: this guidance is generally followed, and is the approach in around 75% of cases where the petrol station has been mapped as an area. In around 3% of cases the area marked as “amenity=fuel” is also tagged to indicate retail landuse, which suggests it covers the whole site. In around 2% of cases it is also tagged as a shop, which suggest that it is intended to represent a building. However, renderers and applications cannot be certain that either is what the contributor intended. In around 20% of cases there is no indication from the tagging what the “amenity=fuel” area represents. Inspection suggests that in most cases it is the paved area around the pumps</li>
<li>the area around the pumps should be mapped as an area of highway: in practice this approach is only used in around 2% of cases, although there are a few more cases where the forecourt area is tagged as “amenity=parking”</li>
<li>use the shop tag alongside “amenity=fuel” to indicate other retail formats within the petrol station, such as a kiosk, or convenience store: this guidance is not generally followed – a shop tag is only used in 10% of petrol stations marked as an area, and only 5% of those marked as a node. Some of these petrol stations may truly have no other retail facilities, of course, but experience suggests that there are not many fuel outlets these days that only offer fuel</li>
<li>the routes through the forecourt should be mapped as one-way service roads: (this I've not measured)</li>
<li>any canopy should be mapped as “building=roof”: (this I've not measured)</li>
<li>add a node for toilets as an amenity: because fuel is treated as an amenity in the tagging, there is little problem in tagging coexistence of a petrol station with with retail formats that are tagged as a shop, but there are potential issues around how best to tag co-existence with other common amenities. This guidance helps with adding toilets, but there is no guidance yet for other common amenities, such as a café </li>
<li>there is no guidance yet on how to map the wider extent of the site – which may include customer parking, children's play areas, etc.</li>
</ul>
<br />
The result is that rendering for some petrol stations presents a reasonable interpretation of the different components on the ground, but this is too unusual, and the underlying data is too inconsistent to be of further use.<br />
<br />
Representing the perimeter of a complex retail outlet would provide geometry information that would be particularly useful for data users. This would offer a mechanism for aggregating different components within the same facility that have been mapped separately (such as identifying a petrol station with toilets and a cafe) . However, for contributors there is confusion over how best to do this. The community is probably nearest to consensus on "landuse=retail", or "landuse=something more specific". However, this approach isn't widely adopted. In any case, it is virtually useless for anything more than rendering, because it loads the "landuse" tag with more than one meaning. Data users are not able to distinguish between cases where the "landuse" tag defines the outline of a specific outlet, and cases where it encompasses a wider area and more retail outlets.<br />
<br />
In summary, the largest gap in the information on the geometry of retail premises is a lack of any information on the footprint for around two-thirds of retail features. In around 4% of cases there is some basic information on footprint, but data users will face considerable difficulty in interpreting what it means.<br />
<br />
Where there is information on retail geometry it can help to identify gaps in data, particularly for building footprints.<br />
<br />
The database also contains information on some more complex retail footprints, but this is not presented in a consistent way, and the various components are not sufficiently well-integrated for applications to make use of the information (other than basic rendering). There is some guidance for contributors on mapping more complex retail features, but this is not widely followed, and I have found no feedback mechanisms to encourage more consistent tagging of complex cases.gom1http://www.blogger.com/profile/07201321705941282416noreply@blogger.com0tag:blogger.com,1999:blog-3395883144047931311.post-19145799260257388602015-07-31T11:51:00.001+01:002015-07-31T11:58:23.247+01:00OSM Retail Survey: Part-12I see that most readers of these posts come from outside the UK. I hope the information is of some interest and use to others, but I should probably emphasise that this is just a survey of UK retail data on OSM. The structure of the retail industry differs from place to place. The UK, for example, has a relatively high proportion of retail turnover through large retail chains: i.e. fewer small retailers than France, and fewer mid-sized retailers than Germany. It would be interesting to know whether similar patterns of OSM data are found elsewhere, or whether there are differences that we can all learn from.<br />
<br />
After the most basic information on the location and type of shop, the most common (and for many data users, the most useful) supplementary information in OSM is the name of the retailer. Some form of name is provided for around 90% of retail premises, but the proportion is lower for certain types of outlet. Most UK Post Offices, for example, do not have a name tag.<br />
<br />
Names will probably be most useful to the data user because they allow searches for a specific retailer. In the UK, understanding the name of the chain may carry relatively high value, because the name often gives a clear idea of the format and range of goods on sale (most people have an idea of what to expect in a branch of Argos, even if the tagging of shop type is inconsistent).<br />
<br />
Names are also a useful characteristic when analysing retail data. Where chains have multiple similar branches, this provides a vehicle for checking tagging consistency across a chain, and information can be extracted on OSM coverage of the larger chains.<br />
<br />
There are numerous variations in the way names are provided by contributors. These fall into several groups:<br />
<br />
<ul>
<li>Variation in capitalisation: Aldi / ALDI, Asda / ASDA, Spar / SPAR, Lidl / LIDL, Pets at Home / Pets At Home</li>
<li>Variations in the use of abbreviations: Co-op, Co-Op / Co-operative, M&S / Marks & Spencer / Marks and Spencer, Toni&Guy / Toni & Guy / Toni and Guy, B&Q / B & Q / B and Q</li>
<li>Variations in the use of a possessive, with or without apostrophe: Sainsbury / Sainsbury's / Sainsburys, Wilkinson / Wilkinsons / Wilkinson's, McColl / McColl's, Jewson / Jewsons, Maplin / Maplins</li>
<li>Variations in the use of a definite article: Co-operative Food / The Co-operative Food, Money Shop / The Money Shop, Body Shop / The Body Shop, Carphone Warehouse / The Carphone Warehouse</li>
<li>Variations in spacing: WHSmith / WH Smith / W H Smith, Kwik Fit / Kwik-Fit, One Stop / One-Stop / OneStop, Phones 4U / Phones4U, TK Maxx / TKMaxx </li>
<li>Including or omitting the location of the branch in the name: “Tesco, Swansea Marina”, “Batley Tesco”, “Tesco Barnstaple”, “Tesco Extra, Hartlepool”, “Tesco - Biggin Hill Express”, “Tesco (Greenock)”, “Tesco Rugeley Superstore”, “Tesco Ystrad Mynach”, “Tesco Extra (24hr) Maldon”, “Tesco South Tottenham Superstore”, and many, many more.</li>
</ul>
<br />
Different names for different formats within a chain are a slightly different issue. Tesco, Tesco Metro, Tesco Express and Tesco Extra can all be considered valid names for different retail formats used by Tesco. Similarly, Sainsbury's and Sainsbury's Local. These cannot really be considered variations in the same name. There is evidence, though that they are not used consistently, so “Tesco” is sometimes used as a synonym for the various different formats (and at other times it isn't).<br />
<br />
It is difficult to put a firm number on how many times all these different kinds of inconsistency occur, but it certainly runs into thousands (i.e. between 1% and 10% of mapped shops). So they are likely to cause some data users a degree of frustration. However, similar patterns recur, and some names are particularly prone to certain variations. With varying degrees of effort data users who place a high value on standardised names will probably be able to find ways to work round many of the differences that are most important to them.<br />
<br />
Occasionally the name will appear as the value in the "shop=" tag, but this is very rare. Various other tags are used to hold different types of name: primarily “name”, “operator”, and “brand”. In around 4% of cases the contributor has provided a name, plus details on the operator, brand, or both, and in less than 2% of cases they have provided information on the operator, or brand, but not the name of the outlet. There is some inconsistency in the way that “operator” and “brand” are used, which will make life a bit difficult for data users.<br />
<br />
Data users who ignore “operator” and “brand”, and use just the “name” field will lose information from around 6% of recorded retail outlets. However, there are certain sub-sectors where the operator or brand tag are more widely used.<br />
<br />
In the case of petrol stations, for example, both are used, but both the brand of fuel and the operator are scattered quite widely across the name, operator and brand tags. For car showrooms contributors normally use the name tag to show the name of the outlet, but it is not uncommon for the name tag to show the car manufacturer. In around 11% of cases the manufacturer appears under brand, but in some cases it appears under operator. This inconsistency in the use of names could be a lost opportunity to provide additional information to data users, but it is difficult to know how much of a problem it will really give them. Anyone who wants to search for a Volkswagen Dealer, for example, will need to search for “VW” or “Volkswagen”. If they are capable of doing that on the name tag, then they will be able to search the name, brand and operator tags almost as easily. If they go to this amount of effort, they will currently pick up around 30 VW dealerships in the UK. This is well short of the true figure of around 200. Again, missing data is a bigger problem here than inconsistent tagging. Sensible end-users who want to find a VW dealer will use the manufacturer's dealer search rather than OSM data.<br />
<br />
For most types of retail there is no major issue with misuse of the “brand” tag. On the whole it is used consistently for car dealerships and filling stations, and little used elsewhere. There is, though, some confusion around tagging of convenience store names. In the UK these are often independently owned and operated, but trading under a well-known national franchise. Examples include SPAR, Londis, Costcutter, Premier Stores and Nisa. Together these represent around a third of the convenience store sector in the UK, so they have a significant presence, but none of the various combinations of “name”, “operator” and “brand” really captures the business model. As a result the way they are tagged is quite inconsistent (roughly 80% of the time the franchise is tagged as “name”, roughly 13% as “operator”, and 6% as “brand”).<br />
<br />
Address details are attached to about a third of retail properties in OSM, but only 15% have a postcode, and the proportion with a complete street address is in the region of 5-10% (depending on what components a user requires in order to regard the address as complete).<br />
<br />
Contact details (web site, or phone) are provided for around 10% of retail properties, although for certain types the proportion is higher. For restaurants and bars, for example, the proportion with contact details is around 20%, and for estate agents around 25%. Is is more common to find a web site than a phone number, and comparatively rare to find both. In the case of restaurants, for example, 15% are tagged with a web site, 10% with a phone number, 5% with both, and 80% with neither. Restaurants have a higher level of coverage for contact details than most retail sectors on OSM, and yet, out of 60,000 restaurants in the UK, OSM has contact details for just over 2,000. This looks long way from being a set of information that is viable enough to attract data users.<br />
<br />
Information on accessibility (“wheelchair=”) is provided for around 4% of retail properties, with a higher proportion for cafés and restaurants (7%) and for supermarkets (8%). Where wheelchair information is provided the value is “yes” in 63% of cases, but “no” in 20% of cases, and “limited” in 16% of cases.<br />
<br />
Information on opening hours is provided for under 3% of retail properties. The types of outlet that fare better than average for this information are an odd mixture: Supermarkets (but not Convenience Stores), Bars (but not Pubs), Pharmacies (but not Post Offices) and Bicycle Shops. Cafés and Restaurants rate only slightly higher than average.<br />
<br />
It's worth looking more closely at an example where the opening hours have been provided more often than average, and where they could play an important role in any feasible application. If I wanted to find a pharmacy near to home, that is open on a Sunday afternoon, then the nearest pharmacy where I can check “opening_hours” on OSM is nearly 50km away (and as it happen, it isn't open on a Sunday afternoon). There are four pharmacists within 100km that OSM tells me are open on a Sunday afternoon, but only one of them shows a phone number. This is potentially an application area where the tagging structure is ready to support a viable application. In London, and a few other towns and cities contributors have been diligent in adding sufficient detail to make a search viable (Stoke on Trent, Norwich,...). But across most of the country, it doesn't look to me as though the data content is anywhere near ready to attract users to this type of data.<br />
<br />
In summary, OSM has the potential to support more sophisticated searches of retail data than a simple location search, in the sense that data structures are in place to hold much valuable information. Where these are used, they are used fairly consistently. However, in most cases coverage of supplementary data is an issue. There is a considerable way to go before the supplementary data is sufficiently complete and consistent. The first priority is probably to work towards more consistent naming. Beyond that, at present, the potential applications for this data are hypothetical, and it is too early for an informed debate on priorities.gom1http://www.blogger.com/profile/07201321705941282416noreply@blogger.com0tag:blogger.com,1999:blog-3395883144047931311.post-67488873405692380132015-07-27T11:00:00.000+01:002015-07-27T11:16:42.695+01:00OSM Retail Survey: Part-11The occupants of a retail premise will change over time, and as a result we should expect retail data in OSM to continually evolve as well.<br />
<br />
Most of the retail data within OSM is less than 5 years old, so the chances are that the bulk of this is still more-or-less current. Around 5% of the data is 5-years old, and 2% is 6 years old. A growing proportion of this older data could now be inaccurate, but across the country it is likely that the proportion of data that is out-of-date will only represent a few percent of the total.<br />
<br />
In some places (e.g. Islington, Leeds, and Sheffield), more than 10% of shops were added to the database over five years ago. In parts of Kent more than 30% of the shops were added more than five years ago. So there may be a case for some local reviews of older data, to update anything that has changed since it was last recorded.<br />
<br />
In most locations, though, the current priority will still be to add missing data, then later work towards greater accuracy.<br />
<br />
In the longer term, that picture is likely to change. In the last 12 months 28,000 retail properties in England have been edited. That's 5% of retail properties that have either been added to OSM, or updated. Some of the changes in OSM data over the last year will have been to correct a spelling, or to adapt tagging, and will not have involved a re-survey. But we can't easily measure how much has been fully updated. So for now, let's be optimistic, and assume that every edit brings that particular shop up to date.<br />
<br />
If nothing changed on the ground, then at this rate it will take more than a decade to approach complete coverage of retail. But the situation on the ground does change. In 2014 the average length of a retail lease was less than nine years, and almost half of retail leases were for less than four years. Retail leases used to be for a longer period, and because of peaks in construction activity in 1990 and 2000 an unusually high number of 25-year, and 15-year leases are currently due for renewal.<br />
<br />
Not all retail property is leased, leases will sometimes be renewed without change of occupant, and some might carry forward for generations. So I don't know what proportion of OSM high street data we should expect to change over a year. If only 5% changes then current levels of editing activity are sufficient to maintain existing data, and gradually close the gap of missing data. But if we assume 10% of existing retail premises change over a year then the current rate at which OSM retail data is being edited will not be enough to deliver and maintain complete and accurate data on all retail properties in England.<br />
<br />
Nationally, perhaps something like 7,000-14,000 entries on the database should be updated each year. Around where I live, the rate of change looks closer to 10% per year, rather than 5%, so I'm guessing a decent estimate of the national picture will be closer to the higher figure.<br />
<br />
As database volumes rise there will be more to maintain. If contributors concentrate on adding missing retail properties, then by the time coverage reaches about 50%, the existing data will be going out of date as fast as new data is being added. If contributors concentrate on maintaining what has already been added, then they will have no time to add the missing 50% of retail properties. Either way, for the foreseeable future, there is going to be a lot of retail data that is either missing from OSM, or incorrect on OSM.<br />
<br />
If we can wait long enough, other factors might help. A decline in the number of retail premises would also accelerate progress towards 100% coverage, and the chart shows the effect of a 2% reduction in the number of retail properties each year. Even if this is factored in, reaching a worthwhile level of retail cover still looks like a slow process. Too slow.
<br />
<br />
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEidygomXTZp1doinbDH2i15U7y4hzDqxW4FH71paXILdSi_X2OT3qPGRO5syEAL5XuDLpbIvOK9DkmldUxbDItx52I0uz-52BeTnwA2hdqU17B3CwE8JgU2vmCGyg_tyaoJ4fZRZpqroGln/s1600/RetailCoverageProjected.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEidygomXTZp1doinbDH2i15U7y4hzDqxW4FH71paXILdSi_X2OT3qPGRO5syEAL5XuDLpbIvOK9DkmldUxbDItx52I0uz-52BeTnwA2hdqU17B3CwE8JgU2vmCGyg_tyaoJ4fZRZpqroGln/s320/RetailCoverageProjected.png" /></a></div>
<br />
It is not only individual shops that change. Retail business models also evolve, and over the long term we should expect this to affect the choice of tags. Some formats which once were common on the high street no longer exist (ironmongers into hardware, then homeware). A traditional grocery, or a video rental shop is now unusual.<br />
<br />
On the other hand, perhaps candle shops are returning to the high street (“shop=candle”), and e-cigarettes are a recent arrival.
The data on chains of mobile phone shops may be an example of how this process continues. Currently these chains are tagged with a mix of “mobile_phone” (95%), and “electronics” (5%). Perhaps contributors are adapting their tagging, in recognition that an established speciality has now matured, and the offer is starting to evolve as retailers extend into adjacent markets.gom1http://www.blogger.com/profile/07201321705941282416noreply@blogger.com0tag:blogger.com,1999:blog-3395883144047931311.post-61877475985920302182015-07-26T19:56:00.004+01:002015-07-26T22:19:50.496+01:00OSM Retail Survey: Part: 10Specialised types of shop offer a narrow range of categories, but provide wide choice within their specialist area. Generalist retailers offer a broad range of product categories, with less choice within each category. Large generalists (e.g. supermarkets) are able to offer both numerous categories and broad choice.<br />
<br />
We use different terms for a large “supermarket” (with breadth and depth), a small “convenience” store (with some breadth and less depth), and a "butcher" or “newsagent” which we expect to be more more specialised. We expect a newsagent to offer a wider choice of newspapers and magazines than a convenience store, but we would still expect a convenience store to offer newspapers. We expect a convenience store to offer much more than newspapers, and we would be surprised if a newsagent offered nothing but newspapers. We expect a butcher to offer a wider choice of meat than a convenience store. Ours does excellent sandwiches, ready meals, pies, vegetables, and various other items as well. Although the principles are fairly clear, the precise boundaries between retail categories are always going to be difficult to pin down.<br />
<br />
As a result, it doesn't matter how clear the definitions are for different terms covering different levels of specialisation. We should still expect some inconsistency in the way that different tags are used. Some retailers have a business model that is closer to the boundary than others, so it is inevitable that there will be a grey area where it is difficult to maintain a consistent boundary. The proper question isn't whether tagging ought to be consistent. It's whether there should be more consistency than we find.<br />
<br />
To my mind there are several areas where the data does not look consistent enough. This is particularly true in the case of large stores which sell a broad range of goods (the big generalists).<br />
<br />
For example, a data user who searches for “supermarket” and relies on the wiki for the definition, will expect to find “a large store for groceries and other goods” “a full service grocery store that often sells a variety of non-food products as well”. They will assume (perhaps because the wiki tells them) that “stores that do not provide full service grocery departments are generally not considered supermarkets”.<br />
<br />
In practice they will find results that include a high proportion of outlets that fit this description, including most branches of the major chains that they will expect to find: ALDI, ASDA, Booths, Co-op, Iceland, Lidl, Morrison's, Sainbury's, Tesco, Waitrose, etc. However, they will also pick up a lot of convenience stores, and some stores tagged “supermarket” where few shoppers would expect to find groceries: Argos, Homebase, Matalan, Mothercare, Pets at Home, etc.<br />
<br />
I estimate that around 10% of the data that they retrieve will not be what they expect.<br />
<br />
Commercial search engines face a similar problem, because smaller convenience stores often call themselves a supermarket, and this is inevitably picked up in their keyword searches. But OSM has a more structured data model. We should expect to perform better.<br />
<br />
The situation with department stores is even more difficult for data users. The major chains are well covered, but they only represent about half of all retail outlets tagged as a department store. Data users who rely on the Wiki definition will be expecting “a large store with multiple clothing and other general merchandise departments”. They probably won't expect to pick up Poundstretcher, Argos, Matalan, Pets at Home, Staples, Superdrug, TK Maxx, etc. - but they will.<br />
<br />
Wilkinson's (Wilko) is a difficult boundary case - with a particularly wide range of different key values for different branches. My own view is that something like “homeware” would be the best description of their format, but only about 2% of contributors agree with me. And in practice, what should matter to data users is not what I think (even when I am right). What has to matter to data users is the consensus that develops across the majority of contributors. And in this particular case there is little consensus. It is difficult for anyone to know whether to consider Wilkinson's a department store or not. What is even more unsatisfactory for data users is that 25% of Wilkinson's stores are considered to be a department store, and even though that's the most popular option, 75% are tagged differently.<br />
<br />
Neither of these examples is the result of a problem with the definition of the tags for a supermarket or a department store. The problem is that the same tags are being quite widely used for branches of chains where most contributors prefer an alternative. Good data on department stores and supermarkets is polluted by inconsistent data on other retail formats.<br />
<br />
Looking further, the confusion lies partly in representing scale consistently, and partly in representing the degree of specialisation consistently.<br />
<br />
Most specialists offer some categories of product that fall outside their main area of activity. Some position themselves as specialists in more than one area. As a result contributors can find it difficult to draw a consistent distinction between a specialist and a generalist outlet. If they are uncertain about the right specialist term to use, they tend to look for something more generic, and fall back on terms intended for generalists. This isn't entirely unreasonable behaviour. For a long time, the guidance, when in doubt, is to pick a popular tag that best fits the situation (rather than inventing a new one). Contributors don't necessarily have an understanding of all the tags in use, and the result is that popular tags that were originally intended to apply to large outlets which offer a broad range are quite commonly used for smaller outlets offering a broad range, and for unusual specialists that are difficult for contributors to classify.<br />
<br />
Looking at this another way, we have a choice of terms for shops which offer a broad range. Contributors who find it difficult to pick an appropriate tag veer towards picking one from a higher row in this table - they are the ones that are most widely used.<br />
<div style="line-height: 100%; margin-bottom: 0cm;">
<br /></div>
<table cellpadding="4" cellspacing="0" style="page-break-inside: avoid; width: 100%px;">
<colgroup><col width="41*"></col>
<col width="72*"></col>
<col width="72*"></col>
<col width="72*"></col>
</colgroup><thead>
<tr valign="top">
<th style="border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; border-top: 1px solid #000000; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm; padding-top: 0.1cm;" width="16%"><span style="color: #999999;"><br />
</span></th>
<th style="border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; border-top: 1px solid #000000; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm; padding-top: 0.1cm;" width="28%"><span style="color: #999999;">Primarily food</span></th>
<th style="border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; border-top: 1px solid #000000; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm; padding-top: 0.1cm;" width="28%"><span style="color: #999999;">Primarily non-food</span></th>
<th style="border: 1px solid #000000; padding: 0.1cm;" width="28%"><span style="color: #999999;">Hardware / building materials</span></th>
</tr>
</thead>
<tbody>
<tr valign="top">
<td style="border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; border-top: none; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm; padding-top: 0cm;" width="16%"><b><span style="color: #999999;">Large generalists</span></b></td>
<td style="border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; border-top: none; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm; padding-top: 0cm;" width="28%"><div align="center">
<span style="color: #999999;">“supermarket”</span></div>
</td>
<td style="border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; border-top: none; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm; padding-top: 0cm;" width="28%"><div align="center">
<span style="color: #999999;">“department_store”</span></div>
</td>
<td style="border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: 1px solid #000000; border-top: none; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0.1cm; padding-top: 0cm;" width="28%"><div align="center">
<span style="color: #999999;">“doityourself” (or sometimes “trade”)</span></div>
</td>
</tr>
<tr valign="top">
<td style="border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; border-top: none; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm; padding-top: 0cm;" width="16%"><b><span style="color: #999999;">Other generalists</span></b></td>
<td style="border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; border-top: none; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm; padding-top: 0cm;" width="28%"><div align="center">
<span style="color: #999999;">“convenience”</span></div>
</td>
<td style="border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; border-top: none; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm; padding-top: 0cm;" width="28%"><div align="center">
<span style="color: #999999;">“general” (rare) or “variety” (for
pound shops)</span></div>
</td>
<td style="border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: 1px solid #000000; border-top: none; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0.1cm; padding-top: 0cm;" width="28%"><div align="center">
<span style="color: #999999;">“hardware”</span></div>
</td>
</tr>
<tr valign="top">
<td style="border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; border-top: none; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm; padding-top: 0cm;" width="16%"><b><span style="color: #999999;">Specialists</span></b></td>
<td bgcolor="#c0c0c0" style="border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; border-top: none; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm; padding-top: 0cm;" width="28%"><div align="center">
<span style="background-color: yellow; color: #999999;">“bakery”, “butcher”, “cheese”, etc.</span></div>
</td>
<td bgcolor="#c0c0c0" style="border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: none; border-top: none; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0cm; padding-top: 0cm;" width="28%"><div align="center">
<span style="background-color: yellow; color: #999999;">“clothes”, “beauty”, “houseware”,
etc.</span></div>
</td>
<td bgcolor="#c0c0c0" style="border-bottom: 1px solid #000000; border-left: 1px solid #000000; border-right: 1px solid #000000; border-top: none; padding-bottom: 0.1cm; padding-left: 0.1cm; padding-right: 0.1cm; padding-top: 0cm;" width="28%"><div align="center">
<span style="background-color: yellow; color: #999999;">“garden_centre”, “paint”, etc.</span></div>
</td>
</tr>
</tbody>
</table>
<br />
<br />
One result of tending towards tags for larger generalists is that supermarkets are over-represented in OSM. Industry figures show 6,410 stores in this category in the UK, whereas I found 7,045 (110%) in OSM. Convenience stores, on the other hand are under-recorded. I found 9,717 out of 48,303 identified by the industry (i.e. just 20%).<br />
<br />
It is obvious from the data that contributors find it difficult to to make a distinction between a supermarket and convenience store. In England and Wales the law on opening hours varies for different sizes of store, with restricted hours on Sunday for those of more than 208 sq. metres (3,000 sq. ft.) So a supermarket of less than 280 square metres (3,000 sq. ft.) would be normally be considered a convenience store, and a convenience store of more than 280 square metres would be considered a supermarket. However, in OSM, at least 9% of outlets marked as a supermarket in OSM (and recorded as an area rather than a node) have a floorspace of less than 280 sq metres. Around one in three of the stores operated by one of the major convenience store chains is tagged as a supermarket. Convenience stores don't have to offer extended opening hours, we can't really expect contributors to measure the footprint, and the situation is further confused because some convenience stores describe themselves as a supermarket. The upshot is that almost a thousand convenience stores in OSM are marked as a supermarket. And meanwhile, because convenience stores are generally under-recorded, around 30% of the general grocery sector has yet to be added to OSM.<br />
<br />
Changing tack, department stores sell a range of general merchandise, typically including clothing, household appliances, toys and games, personal-care products and garden equipment. Some also sell food, but non-specialised food stores are properly classified as supermarkets. With very few exceptions the major UK department store chains, such as John Lewis, Debenhams, and House of Fraser are tagged correctly as a department store. However, not all retail premises tagged “department_store” comfortably fit the description.<br />
<br />
Examples include branches of Argos (normally tagged “catalogue”), TK Maxx and Matalan (normally tagged “clothes”), Poundland (normally tagged “variety_store”, sometimes “convenience” or “supermarket”), Mothercare (normally “baby_goods”, sometimes “clothes”), Wilkinson's (“department_store” for 25% of branches, plus a wide range of different alternatives).<br />
<br />
The Wiki describes Do-It-Yourself-stores as being similar to hardware stores, except generally larger, stocking a wider range of products, and targeting customers who are non-professionals working on home improvements, redecorating, gardening, etc. Pure DIY stores are well covered in the database, and consistently tagged. In the case of Homebase, B&Q and Wickes, for example, more than two-thirds of branches are in the database, and well over 90% are tagged as “doityourself”.<br />
<br />
The same is not true of builders' merchants (which according to the documentation are properly tagged as “trade”). Fewer than 10% of Jewsons, and Travis Perkins branches are in the database, and they are tagged with a mix of “doityourself”, “hardware”, and “trade”, with “doityourself” as the most common.<br />
<br />
There seem to be two issues here. One is that many trade outlets also serve non-professionals, so their business model overlaps with the scope of “doityourself” (this is accepted in the documentation on “shop=trade”, but contributors are either uncomfortable with it, or simply don't recognise these as trade outlets). The other issue is that there are different degrees of specialisation in the trade side of the market. Specialists in supplying the trade with building materials, timber, plumbing, bathroom furniture, electrical goods, tools, etc. all seem to be under-recorded, and inconsistently tagged. Again, where there is no clear consensus, contributors have fallen back on common tags such as “doityourself” and “hardware”, that were originally intended for generalists supplying the non-professional, and so are more widely used.<br />
<br />
Branches of Wilkinson's and Robert Dyas don't fit comfortably into any of the most common categories, so they tend to suffer from highly inconsistent tagging (department_store, doityourself or hardware). We could blame contributors, but surely some of the tagging inconsistency shows that there may be a need for:<br />
<br />
<ul>
<li>more specific options to cover particular retail format that do not comfortably fit the current categories</li>
<li>more generic options, so that contributors have an alternative to popular tags intended for large generalists </li>
</ul>
gom1http://www.blogger.com/profile/07201321705941282416noreply@blogger.com0tag:blogger.com,1999:blog-3395883144047931311.post-37738080676071228902015-07-25T10:06:00.004+01:002015-07-25T10:06:46.515+01:00OSM Retail Survey: Part-9<h2>
False synonyms</h2>
True synonyms add to the confusion, provoke debate, and may discourage some data users, but in practice I suspect “false synonyms” are a bigger problem. By this, I mean tags that are used interchangeably by contributors, even when they are not true synonyms according to the guidelines. Again, we can use major chains to do some cross-checking of whether tags with similar meanings are applied consistently.<br />
<br />
<ul>
<li>Almost every major chain of pharmacies has a mix of outlets tagged as “shop=pharmacy” and “shop=chemist”. </li>
<li>Similarly “alcohol”, “wine”, “beverages” seem to be used interchangeably for chains of off-licences and wine merchants, with “alcohol” as the most common of these. The less common “off-licence” is not widely used on retail outlets</li>
<li>For chains such as Ladbrookes and William Hill, “bookmaker'” is the most common, but “betting” and “gambling” are also quite common </li>
<li>There is a lot of overlap between outlets that are described by the relatively common “doityourself”, and the less common “hardware”, “building_supplies”, “trade”</li>
<li>For “mobile_phone” the less common alternatives are “phone” and “electronics”. Tagging "electronics" could be a symptom of an evolving retail format. Phone looks like a false synonym.</li>
</ul>
<br />
The documentation in the wiki makes it reasonably clear that the above are not true synonyms, but contributors have treated them as synonyms in the sense that similar branches of the same chain use a mix of different values. As a result, data users are unable to tell where there is a true difference, and where there is imprecise tagging. In effect data users are being pushed to treat these as synonyms, even though they are documented as having different meanings.<br />
<br />
These are examples of retail formats that contributors have difficulty with. Data users, those who maintain the documentation, and those who advocate changes to tagging need to be sensitive to where these occur. We'll look in more detail at some common examples shortly.<br />
<h2>
Multi-specialists</h2>
The above are all examples of specialist retailers. Multiple specialities are another area that give contributors a problem. Halfords is one of the most easily identified examples. How best to tag a store that offers both bicycles and car parts? The solutions that contributors have come up with include around 30 different variants:<br />
<br />
<ul>
<li>Choosing just one of the options: “bicycle”, “automotive”, “car_accessories”, “auto_accessories”, “car_parts” and ignoring any other area of specialisation</li>
<li>Contributing a list of options separated by semi-colons: “bicycle;car_parts”, “car;bicycle” “bicycle; car_accessories”, “motor;bicycle”</li>
<li>Using a more generic category: “doityourself”, “hardware”</li>
</ul>
<br />
The usual way to assign multiple values to a key is a list separated by semi-colons. In practice this is not widely used for shops (less than one in a thousand examples), but there are examples which give an idea of other multiple specialities that are giving contributors problems:<br />
<br />
<ul>
<li>“hairdresser;beauty”</li>
<li>“kitchen;bathroom” </li>
<li>“greengrocer;florist”</li>
<li>“dry_cleaning;laundry”</li>
<li>“art;frame”</li>
<li>“car;bicycle”</li>
<li>“shoe_repair;key_cutting”</li>
<li>“bicycle;car_parts”</li>
<li>“tattoo;piercing”</li>
</ul>
<br />
Noticeably, these are all pairs. Happily, there don't seem to be any long lists of shop types. Contributors recognise that the intention is to record mixed types of speciality shop, not to list all the categories of good for sale.<br />
<br />
The limited number of examples mean that these won't give data users a great problem. If they chose to ignore them they won't lose much data. If they prefer to break out the list then it won't give the much difficulty. More importantly, to my mind, contributors are sending signals here about retail formats that they find it difficult to categorise. This could be valuable information for those who maintain the documentation, and those who advocate changes to tagging.gom1http://www.blogger.com/profile/07201321705941282416noreply@blogger.com0tag:blogger.com,1999:blog-3395883144047931311.post-67762827606740222582015-07-24T10:19:00.001+01:002015-07-24T10:19:42.809+01:00OSM Retail Survey: Part-8<h2>
Consistency</h2>
One way to assess tagging consistency is to examine differences in tagging across similar outlets of the larger retail chains. Contributors don't always agree on how to tag similar shops, they don't always follow the guidelines, the guidelines aren't static, and they aren't always consistent.<br />
<br />
Regardless of what the documentation might say, and the merits of any minority view, in practice data users will have to follow the consensus that has been adopted by the majority of contributors.<br />
<br />
In principle crowd-sourcing will end up tagging most of a retail chain with the “correct” tag. By examining variations in tagging across a retail chain we can get an idea of the proportion of outlets that have been tagged according to the consensus, and how many fall outside the consensus. Data users will be able to accommodate variations, to some extent, but they won't be able to accommodate all of them.<br />
<br />
<ul>
<li>In the case of banks, for example, there is very little variation in tagging: 100% of Barclays, HSBC, Natwest, and Lloyds / TSB branches are tagged “amenity=bank”. </li>
<li>In other sectors, Subway doesn't fall far behind the consistency of banks at 95% tagged “amenity=fast_food”.</li>
<li>At the other extreme there are more challenging examples. Wilkinson's seems to be one of the more difficult chains for contributors to classify: “department_store” is the most common choice, but only accounts for 25% of examples. “hardware”, “variety_store”, “doityourself”, “supermarket”, “general”, “convenience”, “household” and “houseware” are also popular. Robert Dyas, with a similar retail format, faces similar difficulties. </li>
<li>In the case of Halfords 42% of branches are tagged “shop=bicycle” (which doesn't really capture their business format) and the rest use a wide variety of tags. </li>
<li>Argos has 40% tagged “shop=catalogue” and the rest a variety. </li>
</ul>
<br />
In general the most specialised chains tend to be tagged more consistently, and the most consistent tagging of all is found within chains of smaller outlets, with a well-established, widely understood, unambiguous specialisation (“estate_agent”, “funeral_directors”, “hairdresser”, “toys”, “optician”, “laundry”, and “travel_agency”). <br />
<br />
Less consistent tagging is found in chains where the specialisation is more ambiguous (“gift”, “catalogue”, “accessories”).<br />
<br />
There are many shops that are not part of a chain, and we can't easily assess how consistently they are tagged. But if we assume that the pattern of tagging inconsistencies across retail chains is repeated across the whole of the retail market, then we can get some idea of how consistent tagging might be overall. In practice there tends to be more consistency across larger chains, and less across smaller chains, so results vary according to how widely we cast the net. As a broad indication we should probably anticipate that something in the region of 20% of retail outlets have been tagged with a value that differs from the one that the majority of contributors would choose (and hence the value that data users would have to expect).<br />
<br />
Some variation is inevitable: retail business models evolve over time, and vary from place to place; different contributors place different emphasis on different characteristics; tagging guidelines change as they are refined. However, if 20% of existing data is tagged with a value different to the one that most contributors would chose, then across England there are almost 30,000 retail premises in the database that data users will find it hard to recognise, and which should perhaps be brought more into line. After the 385,000 missing retail premises, it seems to me that this must rank as the second largest data quality issue.<br />
<h2>
Synonyms</h2>
Many community discussions of tagging inconsistencies revolve around synonyms. The controversy often lies in deciding when different contributors are using different terms to describe exactly the same thing, and when they are using different terms to describe subtle differences.<br />
<br />
Any list of synonyms invites debate, but examples that are unlikely to be controversial, and where the difference is more than a spelling mistake would probably include travel_agent / travel_agency, newspaper / newsagent, jewellery / jewelry, and deli / delicatessen. I suspect that most would also count baby / baby_goods, seafood / fish / fishmonger, bathroom_furnishing / bathroom, beauty_salon / beauty, etc. as true synonyms.<br />
<br />
If this is anywhere near a complete list, then true synonyms do not look like a significant problem across all retail data. Including spelling mistakes they account for fewer than 1% of all shops in the database. However, they represent a higher proportion of data within some categories of shop, and they can account for a significant proportion of the more unusual categories.<br />
<br />
The retail categories where synonyms are likely to present the greatest problem are where they account for a significant proportion of an important category. Everyone will have different ideas of what makes a proportion significant, and a category important, so it is worth considering a couple of real examples.<br />
<br />
I reckon there are about 2,500 delicatessens in the UK, and I can find just under 500 in the database. Of those, 456 are tagged “shop=deli”, and 39 are tagged “shop=delicatessen”. Any data user who searches for “shop=deli” will miss 39 delicatessens in the database with the “wrong” tag value, and will miss about 2,000 delicatessens that aren't in the database at all (or at least not with a recognisable tag). Of the two, the bigger problem is surely the 2,000 missing delicatessens.<br />
<br />
On the other hand, some synonyms have a more balanced mix of values. Out of 950 independent fishmongers in the UK, 80% haven't been recorded at all. Of the 20% of fishmongers that are in the database, 47% are tagged “shop=seafood”, 44% are tagged “shop=fishmonger”, and 9% are tagged “shop=fish”. This is more problematic, because anyone who looks for just one of the values is going to miss about half of the available data. Nevertheless, I suspect that anyone who is thinking of trawling the data for a fishmonger is still going to be scuppered by the 80% that are missing from the database altogether, not the inconvenience of testing for two or three different tag values.<br />
<br />
I reckon that even within the more problematic categories the issues with synonyms aren't difficult to manage. Where data volumes are small, it is not difficult to fix the data. Where data volumes are large, and one value is dominant, then data users who don't look for a synonym will only lose a small proportion of the data. Where volumes are large and synonyms equally matched then keen data users will go to the trouble of testing for several different values.<br />
<br />
Problems with spelling and synonyms are not difficult to fix, but they are relatively small in number, so not the highest priority. The bigger challenge is to achieve greater consistency in the choice of tag for similar shops. The data can provide some pointers on how to do that, but they will wait for the next post.gom1http://www.blogger.com/profile/07201321705941282416noreply@blogger.com0