IdP stops checking remote arp-source after second check when remote content is not changed even if Last-modifed header is set to current time
I made further tests with two locations - both urls are generated on the fly. Added Last-modified: NOW to both. Differnce between locations is: into 1st location I added comment containing current time - so conent always different And For this location idp works fine. For second location idp stops pulling remote source after second time - no further requests, even if the content has been changed later ------
log about the second (last) refresh from remote source : 2015-06-24 14:43:44,268 - DEBUG [net.shibboleth.ext.spring.resource.FileBackedHTTPResource:131] - FileBackedHTTPResource [https://edugate.heanet.ie/rr3/arp/format2/aHR0cHM6Ly9pZHAuaGVhbmV0LmllL2lkcC9zaGliYm9sZXRo/arp.xml|URL [file:/opt/shibboleth-idp/conf/remoteARP.xml]]: Attempting to fetch HTTP resource 2015-06-24 14:43:44,269 - DEBUG [org.apache.http.client.protocol.RequestAddCookies:122] - CookieSpec selected: best-match 2015-06-24 14:43:44,269 - DEBUG [org.apache.http.client.protocol.RequestAddCookies:162] - Cookie [version: 0][name: csrf_cookie_rr][value: 5451b77ad332b8343de51898732b9817][domain: edugate.heanet.ie][path: /rr3][expiry: Wed Jun 24 15:40:45 IST 2015] match [(secure)edugate.heanet.ie:443/remote/arp.xml] 2015-06-24 14:43:44,269 - DEBUG [org.apache.http.client.protocol.RequestAddCookies:162] - Cookie [version: 0][name: rrlang][value: english][domain: edugate.heanet.ie][path: /rr3][expiry: Fri Jul 24 16:51:00 IST 2015] match [(secure)edugate.heanet.ie:443/remote/arp.xml] 2015-06-24 14:43:44,269 - DEBUG [org.apache.http.client.protocol.RequestAddCookies:162] - Cookie [version: 0][name: srr3][value: f2f4cd86bfc8a0de9f9624828896390f31c20a7f][domain: edugate.heanet.ie][path: /rr3][expiry: Wed Jun 24 15:37:40 IST 2015] match [(secure)edugate.heanet.ie:443/remote/arp.xml] 2015-06-24 14:43:44,269 - DEBUG [org.apache.http.client.protocol.RequestAuthCache:75] - Auth cache not set in the context 2015-06-24 14:43:44,270 - TRACE [org.apache.http.impl.client.cache.CacheableRequestPolicy:92] - Request was serveable from cache 2015-06-24 14:43:44,270 - DEBUG [org.apache.http.impl.client.cache.CachingExec:264] - Cache miss 2015-06-24 14:43:44,270 - TRACE [org.apache.http.impl.client.cache.CachingExec:389] - Cache miss [host: https://edugate.heanet.ie; uri: /remote/arp.xml] 2015-06-24 14:43:44,270 - TRACE [org.apache.http.impl.client.cache.CachingExec:577] - Calling the backend 2015-06-24 14:43:44,270 - DEBUG [org.apache.http.impl.conn.PoolingHttpClientConnectionManager:219] - Connection request: [route: {s}->https://edugate.heanet.ie:443][total kept alive: 0; route allocated: 2 of 2; total allocated: 2 of 20]
Please let me know,if you want me to make some specific tests
Thanks, Janusz
Environment
Linux 64bit, tomcat7 and tomcat8, java version "1.8.0_45"
IdP stops checking remote arp-source after second check when remote content is not changed even if Last-modifed header is set to current time
I made further tests with two locations - both urls are generated on the fly.
Added Last-modified: NOW to both.
Differnce between locations is: into 1st location I added comment containing current time - so conent always different
And For this location idp works fine.
For second location idp stops pulling remote source after second time - no further requests, even if the content has been changed later
------ log about the second (last) refresh from remote source :
2015-06-24 14:43:44,268 - DEBUG [net.shibboleth.ext.spring.resource.FileBackedHTTPResource:131] - FileBackedHTTPResource [https://edugate.heanet.ie/rr3/arp/format2/aHR0cHM6Ly9pZHAuaGVhbmV0LmllL2lkcC9zaGliYm9sZXRo/arp.xml|URL [file:/opt/shibboleth-idp/conf/remoteARP.xml]]: Attempting to fetch HTTP resource
2015-06-24 14:43:44,269 - DEBUG [org.apache.http.client.protocol.RequestAddCookies:122] - CookieSpec selected: best-match
2015-06-24 14:43:44,269 - DEBUG [org.apache.http.client.protocol.RequestAddCookies:162] - Cookie [version: 0][name: csrf_cookie_rr][value: 5451b77ad332b8343de51898732b9817][domain: edugate.heanet.ie][path: /rr3][expiry: Wed Jun 24 15:40:45 IST 2015] match [(secure)edugate.heanet.ie:443/remote/arp.xml]
2015-06-24 14:43:44,269 - DEBUG [org.apache.http.client.protocol.RequestAddCookies:162] - Cookie [version: 0][name: rrlang][value: english][domain: edugate.heanet.ie][path: /rr3][expiry: Fri Jul 24 16:51:00 IST 2015] match [(secure)edugate.heanet.ie:443/remote/arp.xml]
2015-06-24 14:43:44,269 - DEBUG [org.apache.http.client.protocol.RequestAddCookies:162] - Cookie [version: 0][name: srr3][value: f2f4cd86bfc8a0de9f9624828896390f31c20a7f][domain: edugate.heanet.ie][path: /rr3][expiry: Wed Jun 24 15:37:40 IST 2015] match [(secure)edugate.heanet.ie:443/remote/arp.xml]
2015-06-24 14:43:44,269 - DEBUG [org.apache.http.client.protocol.RequestAuthCache:75] - Auth cache not set in the context
2015-06-24 14:43:44,270 - TRACE [org.apache.http.impl.client.cache.CacheableRequestPolicy:92] - Request was serveable from cache
2015-06-24 14:43:44,270 - DEBUG [org.apache.http.impl.client.cache.CachingExec:264] - Cache miss
2015-06-24 14:43:44,270 - TRACE [org.apache.http.impl.client.cache.CachingExec:389] - Cache miss [host: https://edugate.heanet.ie; uri: /remote/arp.xml]
2015-06-24 14:43:44,270 - TRACE [org.apache.http.impl.client.cache.CachingExec:577] - Calling the backend
2015-06-24 14:43:44,270 - DEBUG [org.apache.http.impl.conn.PoolingHttpClientConnectionManager:219] - Connection request: [route: {s}->https://edugate.heanet.ie:443][total kept alive: 0; route allocated: 2 of 2; total allocated: 2 of 20]
Please let me know,if you want me to make some specific tests
Thanks,
Janusz