Connector is disconnected

Hi!
I get this error when executing https://bitbucket.org/indeni/indeni-knowledge/src/staging/parsers/src/f5/sys/rest-mgmt-tm-sys-httpd-allowed.ind with command-runner.sh on my indeni instance.

The collector seems to be running the script fine though and it’s returning 1 metrics. Any idea what it could be?

Troubleshooting steps already taken:

  • Upgraded to the latest version of command-runner
  • Tried multiple F5’s - Same result
  • Tried the command manually using curl - Worked fine

Installed Indeni packages:

indeni-backup              6.4.4-kb.5
indeni-cognito             6.4.4-kb.5
indeni-collector           6.4.4-kb.5
indeni-ds                  6.4.4-kb.5
indeni-insight-analytics   6.4.4-kb.5
indeni-server              6.4.4-kb.5
indeni-triton              6.4.4-kb.5
indeni-vigile              6.4.4-kb.5
indeni-walt                6.4.4-kb.5

The full exception:

2018-09-10 22:05:45,425 INFO -- Running 'rest-mgmt-tm-sys-httpd-allowed'
[INFO] [09/10/2018 22:05:45.439] [Command-Runner-akka.actor.default-dispatcher-9] [akka://Command-Runner/user/CommandActor-Device:192.168.70.117-Command:rest-mgmt-tm-sys-httpd-allowed] Executor on receive execute command rest-mgmt-tm-sys-httpd-allowed with operation Some(Execute(HttpOperation(HttpMethod(GET) '/mgmt/tm/sys/httpd', headers: Map(), body: None),rest-mgmt-tm-sys-httpd-allowed,Map(),Map()))
2018-09-10 22:05:45,455 ERROR -- Command execution failure
com.indeni.collector.CommandFailure: Header = Command execution error,
Description = Command 'rest-mgmt-tm-sys-httpd-allowed' failed to execute,
Message = Header = Execution Error,
Description = Connector is disconnected,
,

        at com.indeni.collector.actors.ResultsHandler$$anonfun$waitingForResults$1.applyOrElse(ResultsHandler.scala:72)
        at akka.actor.Actor$class.aroundReceive(Actor.scala:497)
        at com.indeni.collector.actors.ResultsHandler.aroundReceive(ResultsHandler.scala:28)
        at akka.actor.ActorCell.receiveMessage(ActorCell.scala:526)
        at akka.actor.ActorCell.invoke(ActorCell.scala:495)
        at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:257)
        at akka.dispatch.Mailbox.run(Mailbox.scala:224)
        at akka.dispatch.Mailbox.exec(Mailbox.scala:234)
        at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
        at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
        at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
        at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
Caused by: com.indeni.collector.GenericFailure: Header = Execution Error,
Description = Connector is disconnected,

        ... 12 common frames omitted
2018-09-10 22:05:45,457 INFO -- Exiting
[ERROR] [09/10/2018 22:05:45.469] [Command-Runner-akka.actor.default-dispatcher-2] [akka://Command-Runner/user/pool-master] connection pool for PoolGateway(hcps = HostConnectionPoolSetup(192.168.70.117,443,ConnectionPoolSetup(ConnectionPoolSettings(4,0,5,32,1,30 seconds,ClientConnectionSettings(Some(User-Agent: akka-http/10.0.6),10 seconds,1 minute,512,None,<function0>,List(),ParserSettings(2048,16,64,64,8192,64,8388608,256,1048576,Strict,RFC6265,true,Full,Error,Map(If-Range -> 0, If-Modified-Since -> 0, If-Unmodified-Since -> 0, default -> 12, Content-MD5 -> 0, Date -> 0, If-Match -> 0, If-None-Match -> 0, User-Agent -> 32),false,<function1>,<function1>,<function2>)),TCPTransport(None,ClientConnectionSettings(Some(User-Agent: akka-http/10.0.6),10 seconds,1 minute,512,None,<function0>,List(),ParserSettings(2048,16,64,64,8192,64,8388608,256,1048576,Strict,RFC6265,true,Full,Error,Map(If-Range -> 0, If-Modified-Since -> 0, If-Unmodified-Since -> 0, default -> 12, Content-MD5 -> 0, Date -> 0, If-Match -> 0, If-None-Match -> 0, User-Agent -> 32),false,<function1>,<function1>,<function2>)))),akka.http.scaladsl.HttpsConnectionContext@69cb600,akka.event.MarkerLoggingAdapter@47317815))) has shut down unexpectedly

@Alon_Ashkenazi, any ideas?

@Ulrica_de_Fort-Menar FYI, this is blocking IKP-1539 for me.

@matanc @Eyal_Roth anyone can help Patrik?

This is working for me with the latest development build (which shouldn’t be far ahead of 6.4.4). Could you post the full CLI command you’re using with all the arguments (with the user / password obfuscated I suppose)?

Sure thing!

command-runner full-command --basic-authentication $USER,$PASSWORD --ssh $USER,$PASSWORD ~/indeni-knowledge/parsers/src/f5/sys/rest-mgmt-tm-sys-httpd-allowed.ind 192.168.70.117

You ran it against a live server?

This works, but not with this IP. In fact, I can’t ping nor SSH to this IP.

I tried it on these devices: https://indeni.atlassian.net/wiki/spaces/IKP/pages/159056053/F5+Environment

I tried it from my private lab server, to my private F5 device. SSH, ping and HTTPS works fine from the indeni server.

/Patrik

I’m wondering if it’s something to do with the specific version of the command-runner you’re using. Could you try to run with this one (it’s the one I’ve been using)?

If it doesn’t work still, could you run it with the --version flag and upload the output?

This is a very serious issue that you focus here, because of the command run is not very easy things to do,When i face this, I decide to go Router support for help,here they told me the way which I looking forward.