You must delete the files via a list before you can delete the folder:
B4X:
MyList=File.ListFiles(File.DirRootExternal & "/MyProject")
For i= MyList.Size-1 To 0 Step -1
MyFile=MyList.Get(i)
File.Delete(File.DirRootExternal & "/MyProject",MyFile)
Next