Industry · Logistics and supply chain

Logistics and supply chain data from public sources

Logistics and supply chain teams use public web data to see rates, schedules and supplier changes as they happen. We collect published freight and courier rates, carrier schedules, port and customs notices, and supplier prices and lead times from the sites you choose.

Prefer email? Write to sales@crawlmine.com. We reply within one working day.

Lorries parked at a distribution centre seen from above

Why tracking this market by hand fails

Rates, schedules and notices are published on many carrier, port and supplier sites, each in its own format, often as tables or PDFs. Changes matter within days, but teams usually hear about them late.

Public sources we collect from

  • Carrier and courier rate pages
  • Shipping line schedules
  • Port authority notices
  • Supplier and distributor catalogues

We collect publicly visible, non-personal data and do not bypass logins.

Logistics and supply chain use cases for web data

How logistics and supply chain teams use scraped public data, and the fields that feed each use case.

  1. 01

    Rate benchmarking

    Compare published freight and courier rates by lane and weight band.

    • lane
    • weight band
    • rate
    • carrier
  2. 02

    Schedule tracking

    Follow published sailing and service schedules and their changes.

    • service
    • departure
    • arrival
    • status
  3. 03

    Port and customs notices

    Receive new public notices from ports and authorities as structured records.

    • authority
    • notice
    • published at
  4. 04

    Supplier price and lead times

    Track prices and stated lead times on supplier and distributor sites.

    • part
    • price
    • lead time
    • MOQ

How web data helps the business

The value is not the rows. It is the decisions your team can make with current, complete numbers.

Illustration: public logistics and supply chain sources combined into one table, with use cases such as rate benchmarking
  • Lower freight spend

    Procurement teams negotiate with current market rates in hand.

  • Fewer surprises

    Schedule changes and notices arrive in one feed, early.

  • Resilient sourcing

    Supplier price and lead-time changes show where to diversify.

A sample of the output

Every delivery uses one schema across all sources, with a source URL and collection timestamp on each row.

Illustrative layout only. Real samples use your sites and fields.
lanecarrierweight_bandratepublished
Mumbai to Delhicarrier-a0 to 5 kg1182026-01-10
Mumbai to Delhicarrier-b0 to 5 kg1242026-01-10
Mumbai to Chennaicarrier-a0 to 5 kg1312026-01-10

Illustrative layout only. Real samples use your sites and fields.

How it works

You see real data from your own sources before you commit to anything recurring.

  1. 01

    Scope

    You send the sites, fields, volume and schedule. We confirm what is practical and how it should be delivered.

  2. 02

    Sample

    We deliver a small sample or a paid pilot so you can check coverage and quality.

  3. 03

    Production

    We run the feed on schedule, monitor every source and fix scrapers when sites change.

Questions buyers ask

Not covered here? Ask in the quote form and we will answer with your scope.

Can you extract rates from PDFs?

Yes, where the PDFs are public. We parse the agreed tables into structured rows.

Do you track shipments?

No. We collect public rates, schedules and notices, not individual shipment data.

How often can schedules be refreshed?

Daily is common. More frequent runs are possible for a focused list of services.

Talk to us directly

sales@crawlmine.com

Tell us about your logistics and supply chain data needs. A person on our team reads every message.

Email us

Send us the sites tonight. Data by morning.

Tell us which websites and fields you need. We confirm what is practical, how it should be delivered and what it costs.

  • Goes straight to sales@crawlmine.com
  • Reply within one working day
  • A sample or pilot before any recurring plan
  • NDA available before you share details

sales@crawlmine.com