Disaster recovery and virtualisation

[therealdb]

Are you sure you can’t open those devices and look at the electronics? It seems to be simpler than this, to me

Maybe, also, some repair shop could help you. They usually deal with these kind of things and maybe they have something smarter to identify them. May be worth a try.

[parkerc]

@therealdb said in Discover IR codes for lost remote:

Are you sure you can’t open those devices and look at the electronics? It seems to be simpler than this, to me

These items are racked up so it;s not quite as easy as I’d like that option to be - but I am weighing up the hassle of doing that vs doing this

The benefit of making this code/process work is that a) i will have learnt something new - b) This could then be something g that helps others and c) it would give the Broadlink plug-in access to a huge ir bank of codes for people to use.

[parkerc]

Hi,

I’ve been working with the code that was shared (thanks so much), and have trimming it down a bit to work it through in sections, but - here’s my current issue - any ideas ?

(I) if I put the .csv file in the main search folder it does not return any errors, but it also does not print anything out.

/mnt/nas/vera/ircodes/7,7.csv

LuaTest 1.7

Lua file: /etc/cmh-ludl/luatest.lua

Results
No errors
Runtime: 51.4 ms
Code returned: nil

Print output
(none)

Code
   1    
   2       local lfs = require "lfs" 
   3       local dir = "mnt/nas/vera/ircodes/"   -- make this your path to the files 
   4       local split = "[^,]+,[^,]+,[^,]+,[^,]+,[^,]+"  -- (cmd_name,protocol,D,S,F) 
   5        
   6       local prontoCode = '' 
   7    
   8       for file in lfs.dir(dir) do 
   9           if file: match "%.csv$" then 
  10             for line in io.lines(dir .. filename) do 
  11               local cmd_name,protocol,D,S,F = list: match (split) 
  12               if 'power' == cmd_name then 
  13                 print ("$protocol $D $S $F",  protocol,D,S,F) 
  14               end 
  15             end 
  16          end 
  17      end

• When I run it again, I get this, should filename be local or specified ?

LuaTest 1.7

Lua file: /etc/cmh-ludl/luatest.lua

Results
Runtime error: Line 9: attempt to concatenate global 'filename' (a nil value)

Locals
[main]
lfs={ _VERSION="LuaFileSystem 1.6.2", symlinkattributes=function, lock_dir=function, dir=function, _DESCRIPTION="LuaFileSystem is a Lua library developed to complement the set of functions related to file systems offered by the standard Lua distribution", setmode=function, unlock=function, _COPYRIGHT="Copyright (C) 2003-2012 Kepler Project", currentdir=function, touch=function, mkdir=function, lock=function, link=function, attributes=function, chdir=function, rmdir=function }
dir="mnt/nas/vera/ircodes/"
split="[^,]+,[^,]+,[^,]+,[^,]+,[^,]+"
prontoCode=""

Print output
(none)

Code
   1       local lfs = require "lfs" 
   2       local dir = "mnt/nas/vera/ircodes/"   -- make this your path to the files 
   3       local split = "[^,]+,[^,]+,[^,]+,[^,]+,[^,]+"  -- (cmd_name,protocol,D,S,F) 
   4        
   5       local prontoCode = '' 
   6    
   7       for file in lfs.dir(dir) do 
   8           if file: match "%.csv$" then 
   9             for line in io.lines(dir .. filename) do 
  10               local cmd_name,protocol,D,S,F = list: match (split) 
  11               if 'POWER' == cmd_name then 
  12                 print ("$protocol $D $S $F",  protocol,D,S,F) 
  13               end 
  14             end 
  15          end 
  16      end

II) I know we are doing this in sections, but as there are many layers of manufacturer folders and device type sub folders, will the eventual end code systematically search for all *.csv files within all the levels below? E.g.

/mnt/nas/vera/ircodes/Samsung/TV/7,7.csv
/mnt/nas/vera/ircodes/Panasonic/TV/128,0.csv
/mnt/nas/vera/ircodes/Panasonic/TV/128,1.csv
/mnt/nas/vera/ircodes/Panasonic/TV/128,4.csv
/mnt/nas/vera/ircodes/Panasonic/TV/128,9.csv
/mnt/nas/vera/ircodes/Panasonic/DVD Player/128,0.csv /mnt/nas/vera/ircodes/Panasonic/DVD Player/160,0.csv /mnt/nas/vera/ircodes/Panasonic/DVD Player/160,16.csv
/mnt/nas/vera/ircodes/Panasonic/DVD Player/160,18.csv
/mnt/nas/vera/ircodes/Panasonic/DVD Player/160,28.csv
/mnt/nas/vera/ircodes/Panasonic/DVD Player/160,34.csv
/mnt/nas/vera/ircodes/Panasonic/DVD Player/160,4.csv
/mnt/nas/vera/ircodes/Panasonic/Unknown_EUR7617010/170,3csv

I found this online, is that the sort of thing we will need to factor i later on..

Alex  /  Jan 12, 2012

Lua function to traverse all files in a folder recursively

Here is a little function that uses Lua File System (lfs module) in order to traverse all the files in a folder and its sub folders (and their sub folders) recursively. DIR_SEP=”\” &#82…

If I remove the ‘filename’ variable call, and specify a file, it then does this.

LuaTest 1.7

Lua file: /etc/cmh-ludl/luatest.lua

Results
Runtime error: Line 10: attempt to index global 'list' (a nil value)

Locals
[main]
lfs={ _VERSION="LuaFileSystem 1.6.2", symlinkattributes=function, lock_dir=function, dir=function, _DESCRIPTION="LuaFileSystem is a Lua library developed to complement the set of functions related to file systems offered by the standard Lua distribution", setmode=function, unlock=function, _COPYRIGHT="Copyright (C) 2003-2012 Kepler Project", currentdir=function, touch=function, mkdir=function, lock=function, link=function, attributes=function, chdir=function, rmdir=function }
dir="mnt/nas/vera/ircodes/"
split="[^,]+,[^,]+,[^,]+,[^,]+,[^,]+"
prontoCode=""

Print output
(none)

Code
   1   local lfs = require "lfs" 
   2       local dir = "mnt/nas/vera/ircodes/"   -- make this your path to the files 
   3       local split = "[^,]+,[^,]+,[^,]+,[^,]+,[^,]+"  -- (cmd_name,protocol,D,S,F) 
   4        
   5       local prontoCode = '' 
   6    
   7       for file in lfs.dir(dir) do 
   8           if file: match "%.csv$" then 
   9             for line in io.lines(dir .. '7,7.csv') do 
  10               local cmd_name,protocol,D,S,F = list: match (split) 
  11               if 'POWER' == cmd_name then 
  12                 print ("$protocol $D $S $F",  protocol,D,S,F) 
  13               end 
  14             end 
  15          end 
  16      end

[a-lurker]

"list" should be "line"

And /mnt/nas/vera/ircodes/Panasonic/Unknown_EUR7617010/170,3csv files are expected to end in ".csv"

And "file" should probably be changed to "filename"

Refer: https://keplerproject.github.io/luafilesystem/manual.html

Also I see you changed "power" to "POWER", which is correct but it's safer to do this: 'POWER' == cmd_name:upper() to guarantee you get uppercase. You are also using commas in your filenames. While this is allowed in Linux, I'm not so sure it should be encouraged. If that's how they come, so be it.

[parkerc]

Thanks, I’ve made a few adjustments based on feedback, and using just one .csv file for now, which it seems to find ok, based on the print output, but it unfortunately doesn’t extract the POWER information?

LuaTest 1.7

Lua file: /etc/cmh-ludl/luatest.lua

Results
No errors
Runtime: 9.9 ms
Code returned: nil

Print output
7,7.csv     

Code
   1    
   2       local lfs = require "lfs" 
   3       local dir = "mnt/nas/vera/ircodes/"   -- make this your path to the files 
   4       local split = "[^,]+,[^,]+,[^,]+,[^,]+,[^,]+"  -- (func_name,protocol,D,S,F) 
   5        
   6       local prontoCode = '' 
   7    
   8       for filename in lfs.dir(dir) do 
   9           if filename: match "%.csv$" then 
  10                  print(filename) 
  11             for line in io.lines(dir .. filename) do 
  12               local func_name,protocol,D,S,F = line: match (split) 
  13                  -- print(line) 
  14                  -- print (line: match (split)) 
  15               if 'POWER' == func_name:upper() then 
  16                 print ("$protocol $D $S $F",  protocol,D,S,F) 
  17                    print (func_name) 
  18               end 
  19             end 
  20          end 
  21      end

[akbooer]

My fault. A rookie error in the code (which, obviously, I hadn't tested.)

For your purposes, it's probably good enough to use the search string:

local split = "([^,]+),(%.*)" -- (func_name,protocol,D,S,F)

So this I have tested, and it works.

local lfs = require "lfs" 
local dir = "mnt/nas/vera/ircodes/"   -- make this your path to the files 
local split = "^([^,]+),(.*)"  -- (func_name,protocol,D,S,F) 
 
local prontoCode = '' 

for filename in lfs.dir(dir) do 
    if filename: match "%.csv$" then 
      print(filename) 
      for line in io.lines(dir .. filename) do 
        local func_name,etc = line: match (split) 
        if 'POWER' == func_name:upper() then 
          print ("$protocol $D $S $F",  etc) 
        end 
      end 
   end 
end

giving this output, for example:

7,7.csv
$protocol $D $S $F 	NECx2,7,7,2

[parkerc]

Thanks @akbooer

If I’m to use the irptransmogrifier command line interface, I’m going to need to get the format into something like this.

irptransmogrifier render -p -n D=7,S=7,F=2 NECx2

Here is the latest code,

local lfs = require "lfs" 
local dir = "mnt/nas/vera/ircodes/"   -- make this your path to the files 
local split = "^([^,]+),(.*)"  -- (func_name,protocol,D,S,F) 
 
local prontoCode = '' 

for filename in lfs.dir(dir) do 
    if filename: match "%.csv$" then 
      print(filename) 
      for line in io.lines(dir .. filename) do 
        local func_name,etc = line: match (split) 
        if 'POWER' == func_name:upper() then 
          print ("$protocol $D $S $F",  etc) 
	   for word in string.gmatch(etc, '([^,]+)') do
    	     print(word)
	      end
        end 
      end 
   end 
end

Which I’ve tried to update so that the returned values can be seen individually

Print output
7,7.csv
$protocol $D $S $F NECx2,7,7,2
NECx2
7
7
2

However I theoretically need them created into individual variables, however I’m not able to get name them ?

This was my attempt, which didn’t work..

local protocol, device, subdevice, function2 = string.match(etc, '(%a+) (%d+) (%d+) (%d+)')
print('Protocol = ' .. protocol)
print('Device = ' .. device)
print('SubDevice = ' .. subdevice)
print('Function = ' .. function2)

[a-lurker]

Once you get the variables you need, use this line instead of the above - I left out the "-p"

local command = string.format("%sirptransmogrifier render -p -n D=%s,S=%s,F=%s protocol",irptransmogrifierPath,D,S,F,protocol)

[parkerc]

Thanks, but that’s ultimate where I’m struggling.

I can’t work out how to take those 4 comma separated values, and make each one identifiable as a separate variable - D,S,F, protocol

This line returns what I need,

print ("$protocol $D $S $F",  etc) ,

which tells me the values i need are in etc so any idea why this didn’t work ?

local protocol, D, S, F = string.match(etc, '(%a+) (%d+) (%d+) (%d+)')
print('Protocol = ' .. protocol)
print('D = ' .. D)
print('S = ' .. S)
print('F = ' .. F)

[akbooer]

@parkerc said in Discover IR codes for lost remote:

any idea why this didn’t work ?

...because the syntax is wrong.

I've lost count of the number of times that I may have suggested to you that it might just be worthwhile to learn a little bit more about Lua. The effort that you are putting into this shows that a bit of learning will be a very good investment.

This will split the parameters:

local params = "([^,]+),([^,]+),([^,]+),([^,]+)"
local protocol, D,S,F = etc: match(params)

[parkerc]

@akbooer said in Discover IR codes for lost remote:

I've lost count of the number of times that I may have suggested to you that it might just be worthwhile to learn a little bit more about Lua.

I know, and believe me when I say. I honestly try to lean aspects of Lua when I can. but - I don’t know if you recall my responses in the past - my job and other commitments leave me so little time to learn anything for any length of time. And when I do find a pocket of time to play, I’m eager to create something new and interesting , and obviously use that as time to learn in the process.

To make it worse, not being a programmer, and not being able to work with LUA on a daily basis, so much of what I learn is sadly lost - through lack of use..

Not meant to be a sob story, just something I have to work with - hence I’m always so grateful for your help and the help of others..

[parkerc]

It looks like I finally have the main function in good shape Next on the list is to understand how the IrpTransmogrifier element fits in.

FYI - I’ve added a logging facility to the code, so that I can keep track of the .csv files accessed and the codes sent.

function scanIndexFiles ()
	local lfs = require "lfs" 
	local dir = "mnt/nas/vera/ircodes/"   -- make this your path to the files 
	local split = "^([^,]+),(.*)"  -- (func_name,protocol,D,S,F) 

    local prontoCode = ''

    for filename in lfs.dir(dir) do 
    	if filename: match "%.csv$" then 
  	    print('Filename =' ..filename) 
 	     for line in io.lines(dir .. filename) do 
			local func_name,etc = line: match (split) 
			local params = "([^,]+),([^,]+),([^,]+),([^,]+)"
			local protocol, D,S,F = etc: match(params)
				if 'POWER' == func_name:upper() then 
				-- print ("$protocol $D $S $F",  etc) 
				print('Protocol = ' .. protocol)
				print('D = ' .. D)
				print('S = ' .. S)
				print('F = ' .. F)

			  local irptransmogrifierPath = "insert path here"

              -- this may all need work depending on whatever "irptransmogrifier" does
			  
              local command = string.format("%sirptransmogrifier render -n D=%s,S=%s,F=%s protocol",irptransmogrifierPath,D,S,F,protocol)
			  print(command)
              local handle = assert(io.popen(command))
              local prontoCode = handle:read("*a")
              handle:close()
			  print(prontoCode)

				local time = os.date("%Y-%m-%d %H:%M:%S") 
				local file = io.open("/www/test_write.txt", 'a') 
				file:write(time .. "; " .. filename .. "; " .. protocol .. "; " .. D .. "; " .. S .. "; " .. F .. "\n")
				file:close()
			  
              local INTERVAL_SECS = 2
              --luup.call_delay('sendProntoCodeToBroadLinkDevice', INTERVAL_SECS, prontoCode)

            end
          end
       end
    end
end

[parkerc]

Current sticking point is - what do I do about the ‘Java’ requirement for getting IrpTransmogrifier to run on Vera.. Any recommendations?

To help narrow down my options; I’ve also posted this question on the Vera forum to see if anyone installed/used it.. -

Oct 4, 2020

Need a Java virtual machine (JVM, "Java runtime environment") to run something

Looking online, there are a few out there… http://jamvm.sourceforge.net/ Here’s an OpenWrt and JamVM here → Multithreaded Randomness: Java on OpenWRT … be good to know if anyone has installed/used one of them on Vera.

Hoping this is the final piece to the puzzle and then we’re hopefully good to go....

JamVM seems the most likely...

[akbooer]

I’d be really surprised if that fitted. What type of Vera is it?

[parkerc]

VeraPlus.

The MIPS processor seems to be supported..

GitHub - xranby/jamvm: JamVM is a new Java Virtual Machine conforming to the JVM specification edition 2 (blue book). Clone of git://git.code.sf.net/p/jamvm/code

JamVM is a new Java Virtual Machine conforming to the JVM specification edition 2 (blue book). Clone of git://git.code.sf.net/p/jamvm/code - xranby/jamvm

[akbooer]

@parkerc

Java on OpenWRT

"...a Java VM is out of the question"

[parkerc]

@akbooer said in Discover IR codes for lost remote:

@parkerc

Java on OpenWRT

"...a Java VM is out of the question"

Interesting, as when I had read that part, I assumed he was just referring to your normal/standard approach to installing a Java VM on anything, as later in his point (3) he goes on to say ....

3. Finding a lightweight Java VM that runs on MIPS. If you Google for "java openwrt" there are a lot of forum postings lamenting the lack of a working JVM for OpenWRT. However, jamvm (an actively maintained lightweight JVM) has had an OpenWRT ipkg right there in the OpenWRT opkg repository for a couple of years.

Goes on in (4) to propose..

opkg install jamvm

Which, considering how Vera is set up, that’s not a package you can install via that route..

root@MiOS_5247999:/tmp/verair# opkg install jamvm
Unknown package 'jamvm'.
Collected errors:
 * opkg_install_cmd: Cannot install package jamvm.
root@MiOS_ 5247999:/tmp/verair#

It would be good to have everything I need for this all on the same machine; looking at the specification of a VeraPlus, does anyone think it has the resources ?

Spec / Vera Plus
CPU = 880MHz MIPS SoC
Flash Memory = NAND 128MB
Memory = DDR3 256MB

[a-lurker]

@parkerc said in Discover IR codes for lost remote:

does anyone think it has the resources ?

No.

Forget doing this on a Vera. It would be easier to use, say Windows. Any recent Win machine probably already has the JRE already installed. Just install Lua on the Win machine (refer Google), get the code working (can still use Vera to test the majority of the code) and the call the IR transmitter on Vera with a URL, just like any other function (refer MiOS wiki) can be executed.

The install info for IrpTransmogrifier already has a batch file available ready to run it (refer to IrpTransmogrifier GitHub release and documentation pages). Basically IrpTransmogrifier is a Java program and needs to be executed by something that knows how to do it eg JVE. Just like windows knows how to execute Windows executables.

What does IrpTransmogrifier do? Lots of stuff but in your case it can generate (or as they prefer "render") actual codes, when feed a little bit of information. ie the parameters that define a code in a concise manner - that is: protocol,D,S,F

[parkerc]

Thanks

Agreed, it doesn't really matter where the ‘processing’ is done, (doing it all on Vera just seemed the easiest) - but I ultimately just need to have a facility where I can search, find and the raise a request (all of which is so far unproven/tested) for the ‘POWER’ IR commands via ...

irptransmogrifier render -p -n D=7,S=7,F=2 NECx2

... and then have it (hopefully) return the command in the pronto code/format I want ....

0000 006C 0000 0022 00AD 00AD 0016 0041 0016 0041 0016 0041 0016 0016 0016 0016 0016 0016 0016 0016 0016 0016 0016 0041 0016 0041 0016 0041 0016 0016 0016 0016 0016 0016 0016 0016 0016 0016 0016 0016 0016 0041 0016 0016 0016 0016 0016 0016 0016 0016 0016 0016 0016 0016 0016 0041 0016 0016 0016 0041 0016 0041 0016 0041 0016 0041 0016 0041 0016 0041 0016 06FB

.. and then once I have it, I just need to get that returned ‘code’ into your Broadlink request..

function sendProntoCodeToBroadLinkDevice(prontoCode)
   local BROADLINK_DEVICE_ID = 49
   luup.call_action('urn:a-lurker-com:serviceId:IrTransmitter1', 'SendProntoCode', {ProntoCode = prontoCode}, BROADLINK_DEVICE_ID)
end

sendProntoCodeToBroadLinkDevice(prontoCode)

It all seem so do-able when I started.

[parkerc]

Hi all

The plan on this now is to generates a CSV file, one line per signal, containing the filename, the ‘POWER’ command was found in, its protocol, and the D, S, and F parameters, that I can then import into IrScrutinizer (which is basically IrpTransmogrifier with a GUI), and then export that in the Pronto format .

Currently the following code to create the .csv is not going recursively through all the folders, any advice ?

function scanIndexFiles ()
	local lfs = require "lfs" 
	local dir = "mnt/nas/vera/ircodes/"   -- make this your path to the files 
	local split = "^([^,]+),(.*)"  -- (func_name,protocol,D,S,F) 
	local time = os.date("%Y-%m-%d %H:%M:%S") 
	
    local prontoCode = ''

    for filename in lfs.dir(dir) do 
    	if filename: match "%.csv$" then 
		for line in io.lines(dir .. filename) do 
			local func_name,etc = line: match (split) 
			local params = "([^,]+),([^,]+),([^,]+),([^,]+)"
			local protocol, D,S,F = etc: match(params)
				if 'POWER' == func_name:upper() then 
			
			local file = io.open("/www/powerircodes.txt", 'a') 
			print(filename .. "; " .. protocol .. "; " .. D .. "; " .. S .. "; " .. F .. "\n")
			file:write(filename .. "; " .. protocol .. "; " .. D .. "; " .. S .. "; " .. F .. "\n")
			file:close()
            end
          end
       end
    end
end

scanIndexFiles()