1. ASHNET library update 1.12.164: refinement to HTTP.SBR to allow custom
headers to be added to a GET request (XHTTPF_REQGET). Previously this was
only possible with the POST request type (XHTTPF_REQPOST / XHTTPF_REQUPLOAD).
To specify custom headers, set the XHTTPF_HDRBODY flag and put the new
headers into the request$ parameter, using chr(13) to separate multiple
headers, e.g.:

   flags = XHTTPF_REQGET or XHTTPF_HDRBODY
   request$ = "Referer: http://www.microsabio.com"
   request$ += chr(13) + "User-Agent: A-Shell/ashnet-1.2.164"
   ...
   xcall HTTP, 1, status, flags, url$, request$, response$, properties$

Note that you must specify at least 7 parameters (i.e. at least thru the
properties$ parameter), even if the properties$ parameter is blank.
(Otherwise a more limited version of the routine will be used, which
doesn't support this enhancement.)

You can also put the custom headers into a file, as you would with
XHTTPF_REQPOST + XHTTPF_FILEREQ + XHTTPF_HDRBODY. (With the GET request,
anything following the first blank line would be ignored.)

Note that to examine/debug your headers, set the XHTTPF_DEBUG flag and
then look at the DEBUG.LOG file on return from the XCALL.
  

++INCLUDE ashinc:http.def


! http communication
map1 http'params
    map2 http'flags,b,4
    map2 http'url,s,0,""
    map2 http'upload,s,2000,""
    map2 http'response,s,4000,""
    map2 http'status,f
    map2 http'properties,s,100,""
    
    http'flags = XHTTPF_SSL
    http'flags = http'flags or XHTTPF_REQGET
    http'flags = http'flags or XHTTPF_HDRBODY
    http'flags = http'flags or XHTTPF_DEBUG
    
    http'url = "https://test-api.service.hmrc.gov.uk/organisations/vat/524813945/obligations?status=O"
    
    http'upload = ""
    http'upload += "Accept: application/vnd.hmrc.1.0+json" +  CHR(13)
    http'upload += "Authorization: Bearer fe621927641ad70f7116b41de42252" +  CHR(13)
    http'upload += "Content-Type: application/json"
    
    xcall http, 1, http'status, http'flags, http'url, http'upload, http'response, http'properties
    
    ? http'status
    ? http'response

---- Sending ----
GET /organisations/vat/524813945/obligations?status=O HTTP/1.1
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
Connection: keep-alive
User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:49.0) Gecko/20100101 Firefox/49.0
Accept-Language: en-us,en;q=0.5
Accept-Encoding: gzip
Host: test-api.service.hmrc.gov.uk


---- Received ----
HTTP/1.1 401 Unauthorized
Content-Type: application/json; charset=UTF-8
Content-Length: 92
Accept-Encoding: gzip
Accept-Language: en-us,en;q=0.5
Cache-Control: no-cache, max-age=0
Pragma: no-cache
WWW-Authenticate: Bearer realm="HMRC API Platform"
Strict-Transport-Security: max-age=31536000;
Date: Wed, 03 Apr 2019 08:44:28 GMT
Connection: keep-alive

{ "code" : "MISSING_CREDENTIALS", "message" : "Authentication information is not provided" }

ChilkatLog:
  QuickGetStr(281ms):
    DllDate: Nov 13 2016
    ChilkatVersion: 9.5.0.64
    UnlockPrefix: MCRSABHttp
    Architecture: Little Endian; 32-bit
    Language: Linux C/C++
    VerboseLogging: 1
    url: https://test-api.service.hmrc.gov.uk/organisations/vat/524813945/obligations?status=O
    httpRequestStr(281ms):
      sessionLogFilename: debug.log
      a_quickReq(281ms):
        quickHttpRequest(281ms):
          httpVerb: GET
          url: https://test-api.service.hmrc.gov.uk/organisations/vat/524813945/obligations?status=O
          openHttpConnection(240ms):
            Opening connection directly to HTTP server.
            httpHostname: test-api.service.hmrc.gov.uk
            httpPort: 443
            ssl: 1
            bUsingHttpProxy: 0
            httpProxyAuthMethod:
            socket2Connect(240ms):
              connect2(240ms):
                hostname: test-api.service.hmrc.gov.uk
                port: 443
                ssl: 1
                connectImplicitSsl(240ms):
                  Clearing TLS client certificates.
                  connectSocket(70ms):
                    domainOrIpAddress: test-api.service.hmrc.gov.uk
                    port: 443
                    connectTimeoutMs: 30000
                    connect_ipv6_or_ipv4(70ms):
                      Single-threaded domain to IP address resolution
                      connecting to IPV4 address...
                      ipAddress: 104.127.42.135
                      createSocket:
                        Setting SO_SNDBUF size
                        sendBufSize: 262144
                        Setting SO_RCVBUF size
                        recvBufSize: 4194304
                      --createSocket
                      connect(28ms):
                        Waiting for the connect to complete...
                        myIP: 172.16.0.12
                        myPort: 50198
                        socket connect successful.
                      --connect
                    --connect_ipv6_or_ipv4
                  --connectSocket
                  clientHandshake(170ms):
                    The client cert chain is NULL.
                    cacheClientCerts:
                      Cached TLS client certificates.
                      Client cert chain is NULL.
                    --cacheClientCerts
                    clientHandshake2(169ms):
                      readHandshakeMessages(24ms):
                        processHandshakeRecord:
                          processHandshakeMessage:
                            processServerHello:
                              negotiatedTlsVersion: TLS 1.2
                              negotiatedCipherSuite: TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384
                              minAcceptableRsaKeySize: 1024
                            --processServerHello
                          --processHandshakeMessage
                        --processHandshakeRecord
                      --readHandshakeMessages
                      buildClientKeyExchange(30ms):
                        buildClientKeyExchangeECDHE(30ms):
                          verifyServerKeyExchange(3ms):
                            verifyHash(3ms):
                              keyType: Public
                              hashInSize: 32
                              padding: PKCS v1.5
                              HashOid: 2.16.840.1.101.3.4.2.1
                            --verifyHash
                          --verifyServerKeyExchange
                          Verified server key exchange.
                          generateNewKey_ecc(13ms):
                            loadCurveByName:
                              name: secp256r1
                            --loadCurveByName
                          --generateNewKey_ecc
                          loadSshPubKey:
                            loadCurveByName:
                              name: secp256r1
                            --loadCurveByName
                          --loadSshP

lrwxrwxrwx 1 omni omni       25 Apr  3 09:06 libashnet.so.1 -> libashnet.so.1.12.164.el5
-rwxrwxrwx 1 omni omni  6180088 Feb 13  2017 libashnet.so.1.10.158.el5
-rwxr-xr-x 1 omni omni  7475230 Apr  2 20:27 libashnet.so.1.12.164.el5

$ ls -l /usr/lib/libashnet*
lrwxrwxrwx 1 root root 39 Apr  4  2018 /usr/lib/libashnet.so.1 -> /vm/miame/bin/libashnet.so.1.12.164.el5

---- Sending ----
GET /organisations/vat/524813945/obligations?status=O HTTP/1.1
Accept: application/vnd.hmrc.1.0+json
Connection: keep-alive
User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:49.0) Gecko/20100101 Firefox/49.0
Accept-Language: en-us,en;q=0.5
Authorization: Bearer fe621927641ad70f7116b41de42252
Accept-Encoding: gzip
Host: test-api.service.hmrc.gov.uk


---- Received ----
HTTP/1.1 401 Unauthorized
Content-Type: application/json; charset=UTF-8
Content-Length: 93
Accept-Encoding: gzip
Accept-Language: en-us,en;q=0.5
Cache-Control: no-cache, max-age=0
Pragma: no-cache
WWW-Authenticate: Bearer realm="HMRC API Platform"
Strict-Transport-Security: max-age=31536000;
Date: Wed, 03 Apr 2019 15:37:23 GMT
Connection: keep-alive

{ "code" : "INVALID_CREDENTIALS", "message" : "Invalid Authentication information provided" }

...
    ? "Status: ";http'status
    ? "Response: ";http'response
    
    if http'status <= 0 then
        xcall http, 1, http'status, XHTTPF_GETSTSTXT, "", "", http'response
        ? "GETSTSTXT: "
        ? http'response
    endif

Status:  0
Response: 401 Unauthorized
GETSTSTXT:
401 Unauthorized (ConnectFailCode=0)

Status:  401
Response: { "code" : "INVALID_CREDENTIALS", "message" : "Invalid Authentication
information provided" }