Android Question B4A Audio/DSP Capabilities

[code4fun]

Hello,

First of all, I am sorry if i am not posting this in the right place.

As the title says, I would like to know what can be achieved with b4a on the audio domain. I am talking about things like oscillators, envelopes, fm-am-granular synthesis, sampling, midi, effects (you name it). Two examples of mobile apps that i aim for developing are these:
1)http://www.wizdommusic.com/products/morphwiz.html
2)http://www.wizdommusic.com/products/samplewiz.html
(Hope it's okay to post these links)

I've seen that there's an FFT library available, which is great for starters, but is that all? Are there any other libraries available, capable of audio processes like those mentioned earlier? Would realtime DSP be possible? And what are the latency expectations?

Thnx in advance and sorry for my english.

 

[Erel]

Android doesn't provide these features as part of the OS.

Currently there isn't any library available in Basic4android for Audio processing. If you find a Java library then in most cases it should be quite simple to wrap it and use it with Basic4android.

 

[code4fun]

Android doesn't provide these features as part of the OS.

Currently there isn't any library available in Basic4android for Audio processing. If you find a Java library then in most cases it should be quite simple to wrap it and use it with Basic4android.

Okay, so i've done some research and found out something really worth mentioning.
If you haven't ever heard of Pure Data (PD), it is an open source visual programming language. It has a solid DSP engine capable of most of the audio processes being used. Good news is that they have ported PD on mobile devices, running it as an external library, called Libpd. If Libpd could be imported into b4a, it would open up so many new possibilities for audio dsp.
These links might help:
http://puredata.info/ (Pure Data Homepage)
http://puredata.info/downloads/libpd (Libpd Description)
https://github.com/libpd/libpd (Libpd Files)
http://libpd.cc/portfolio/showcase/ (Some pretty neat apps made with Libpd)

Another interesting open-source audio library i found is Patchfield.
http://google-opensource.blogspot.tw/2013/09/patchfield-for-android.html (Patchfield Description)
http://www.youtube.com/watch?v=LTisevoxm64 (Patchfield Video Demonstration)
https://github.com/google/patchfield (Patchfield Files)

Quite interesting fact is that the Lead Programmer for both Libpd and Patchfield is the same guy, Peter Brinkmann.

I hope you have the time to check these links. I am really looking forward to your reply.

 

[Erel]

This is indeed an interesting library: https://github.com/google/patchfield

I currently do not know whether we will "wrap" it or not.

 

[code4fun]

In the project layout of Patchfield it states:

• PatchfieldPd Library project providing an audio module implementation that uses libpd for synthesis. This project is a not a toy; libpd is a heavy-duty signal processing library, and this project fully integrates it into Patchfield.

So from what i can understand, if patchfield gets implemented into b4a we get libpd too. Is that correct? 2 in 1 sounds awesome!

 

[rgately]

I would REALLY like to see Patchfield and/or Pure Data functionality brought into B4A