Reply by Bob Cain May 29, 20042004-05-29

Mark Ovchain wrote:


> Were I you, I'd think about the dual of frequency domain aliasing. > Instead of relying on this infinite extension, you can simply cope > with the wrap-around as something akin to aliasing. Very akin, I > think, in the dual domain.
Precisely! (Sorry to jump back in so late in the disussion, I was doing something else for a while.)
> But it's not necessary. When you persist in arguing that it's > necessary, you make any number of things harder to understand, IN MY > OPINION. You can not, furthermore, argue that the extension is > NECESSARY.
Which has also been the basis of my argument. I don't feel quite so lonely now. :-)
> And, further, it sometimes seems to obscure the other properties of > the DFT.
Amen. Bob -- "Things should be described as simply as possible, but no simpler." A. Einstein
Reply by Mark Ovchain May 21, 20042004-05-21
rbj@surfglobal.net (robert bristow-johnson) wrote in message 
> so what theorem of linear operators in Hilbert spaces says that the > DFT does not periodically extend its data?
If you said "can not be interprted as" the answer is "nothing". As phrased, your question is questionable itself, depending on interpretation. You seem determined to insist that either it is periodic, or it's not, and that the two are exclusive. That, sir, isn't true. The first way the DFT was created was periodic, and that interpretation remains valid, although UNNECESSARY. UNNECESSARY. UNNECESSARY. The transform is now also understood to be part of a class of orthonormal transforms, known to hold certain properties. No extension need exist. Not 'does exist', but NEED EXIST.
> > Orthonormality has all to do with it, Robert, all. > > well proven, my dear man.
Indeed it is, in any modern linear algebra text. Why would you demand that I reproduce something well known and long established, other, perhaps, than for rhetorically offensive purposes.
> I am not the only person arguing. but since you're the person who > says "physician heal thyself", that must put you above such criticism.
Would you care to address the issue instead of engage in entirely offensive ad-hominem attacks? You can deny the issues until you get old and grey, but your insistance that I'm making these assertions is still going to be wrong. They are well known properties, they are addressed in linear algebra texts, and it's absurd of you to demand that I recite the proof here for your convenience.
Reply by Stephan M. Bernsee May 20, 20042004-05-20
Bob Cain <arcane@arcanemethods.com> wrote in message news:<c7qupf02hit@enews2.newsguy.com>...
> Stephan M. Bernsee wrote: > > > > No! For example, let's consider two signals of length N, where N is > > your transform size. Both signals could be said to be defined inside > > that region and zero everywhere else. If you convolve them by > > multiplying their Fourier coefficients you get a result that can only > > be explained if you accept that the transform is periodic. > > But if you double the size of the transform by sinc > interpolation between the existing frequency samples, you > get the correct results without appeal to anything outside > the transform region.
"Correct result" is a bit misleading. You may get the "desired" result for your application if you do that, but the result of the DFT is *always* correct in the sense of its definiton.
> You need to double the size of the > basis set for correct representation without time domain > aliasing, not make any assumptions about what is outside the > transform region.
No, not really. It's like saying that you need to double the sample rate to get rid of frequency domain aliasing. You're not getting rid of it, you're just pushing the limits so you don't see it in your current context. If you double the transform size, you are just extending the the periodicity but that does not change the fact that it is still there, and will ever be. It's just like saying that it does not matter whether earth is a sphere or a disk - just because you cannot see past the horizon. It may not really matter for your life if you don't leave your home, but it does matter from a global POV. And as I've tried to explain - what you are proposing (a transfom with rectangularly windowed complex exponentials as basis) isn't likely to give you any meaningful result since it does not comply with the BL theorem that says that such a thing isn't practical. If you assume periodicity (just another way to say that the basis functions are unlimited in time) you get to the DFT, which works fine. Regards, --smb
Reply by robert bristow-johnson May 20, 20042004-05-20
mark_ovchain@yahoo.com (Mark Ovchain) wrote in message news:<d61ab25b.0405190952.3b89e227@posting.google.com>...
> rbj@surfglobal.net (robert bristow-johnson) wrote in message news:<4cbb922e.0405180824.611895a9@posting.google.com>... > > whatever you mean by "stands on it own". it *is* a linear algebraic > > transform, if by that you mean it's a linear operator in a hilbert > > space. > > That is a "yes". > > So, therefore, we can use the theorems that apply, caring no more.
so what theorem of linear operators in Hilbert spaces says that the DFT does not periodically extend its data?
> > wrong. if you use the shifting or convolution operators, you need to > > care about the periodic extension (one way to "care" about it is to > > zero-pad sufficiently) or you will get incorrect results. > > Please think again.
why are you so certain i haven't been thinking about this. perhaps you should be thinking again about this.
> We know it's the right kind of transform. So we know what happens. > > Orthonormality has all to do with it, Robert, all.
well proven, my dear man. BTW what is the proof? may we see it? after all you are the person who repeatedly claimed i didn't prove my case (which is untrue). can you abide by your own standards?
> Please, please, stop arguing otherwise.
i am not the only person arguing. but since you're the person who says "physician heal thyself", that must put you above such criticism. r b-j
Reply by Mark Ovchain May 19, 20042004-05-19
rbj@surfglobal.net (robert bristow-johnson) wrote in message news:<4cbb922e.0405180824.611895a9@posting.google.com>...
> whatever you mean by "stands on it own". it *is* a linear algebraic > transform, if by that you mean it's a linear operator in a hilbert > space.
That is a "yes". So, therefore, we can use the theorems that apply, caring no more.
> wrong. if you use the shifting or convolution operators, you need to > care about the periodic extension (one way to "care" about it is to > zero-pad sufficiently) or you will get incorrect results.
Please think again. We know it's the right kind of transform. So we know what happens. Orthonormality has all to do with it, Robert, all. Please, please, stop arguing otherwise.
Reply by robert bristow-johnson May 18, 20042004-05-18
mark_ovchain@yahoo.com (Mark Ovchain) wrote in message news:<d61ab25b.0405161710.181d69a5@posting.google.com>...
> rbj@surfglobal.net (robert bristow-johnson) wrote in message news:<4cbb922e.0405142205.3def6089@posting.google.com>...
...
> > > The historical meaning of the DFT is quite clear. > > > > fine. but i never made any appeal to the historical. my only issues > > here are conceptual (or foundational) and practical. > > You have not shown why there is any need whatsoever to appeal to the > periodic nature of the DFT.
multiple times, with many keystrokes i have shown that the very definition of the DFT and iDFT indicate that x[n] and X[k] are periodic, even though only N samples are passed to the DFT or iDFT. i (and the textbooks) also have shown why the periodic extension (or modulo N arithmetic on the indices, which i maintain is precisely the same thing) is necessary to shifting and convolution and that you will not get the same quantitative result if you don't do it.
> > again, repeating a fallacy doesn't sell it here. dunno why you say i > > am putting words in your mouth. these words (above) are plenty to > > take issue with. > > Please show where insisting on infinite periodicity is NECESSARY in a > DFT. > You have never done that.
says you. in fact i have repeated shown that it is necessary in all but the most trivial operations of the DFT (that is all but linearity). for some reason, you choose to include my example of linearity (where periodicity makes no difference) and delete the other two examples where periodicity *does* make a difference.
> Taken as a linear-algebraic transform there is no, zero need to insist > on any thing outside the time limits of the DFT.
it has nothing to do with "linear-algebraic transform". it's an orthogonal issue. there are plenty of linear-algebraic transforms that do not have this periodic property. but the DFT is a linear-algebraic transform that does.
> The fact that, yes, > you CAN have another interpretation is sometimes useful, I agree, but > you have done nothing to show that it's necessary. You can't, because > it's not.
i'm sure that because you keep repeating that i "can't" and that "it's not" somehow makes it true.
> You demand I prove the negative, and you refer to what I am saying as > a fallacy.
i'm only requiring you to prove that when shifting or convolution is done with the DFT that either periodic extension (or modulo N arithmetic with the indices which is the same thing) is not necessary or that all operations in practice with the DFT can somehow be done without the use of shifting or convolution (leaving, basically, only linearity).
> But you offer no positive proof that what you insist is necessary is > necessary. > > The obligation to your extraordinary claim is entirely upon you.
> Since I can show that the DFT is orthonormal,
orthonormal has nothing to do with this issue. it's a red herring.
> and since you have stipulated > that, I have fully, absolutely, and incontrovertibly proven my point > already, and you have so stipulated.
here is another fallacy: claiming your debate opponent has stipulated to your position when he hasn't.
> But yet you claim that when I say that, I'm repeating a "fallacy". > > Your position is inconsistant, and your use of the word "fallacy" a > professional insult of the worst kind, yet you have stipulated the > truth of my position already.
here is another fallacy: redefining the meaning of som word (in this cas "fallacy"), hyping up the emotion ("professional insult of the worst kind"), and expecting your opponent to back down rather than push their point. A fallacy is a general type of appeal (or category of argument) that resembles good reasoning, but that we should not find to be persuasive. type "fallacy" into Google and you will see manifold web pages dedicated to exploring what the most classical fallacies are. i am saying that you are repeated using the "red herring" fallacy (of which the "straw man" is a subset) to make your argument because you are avoiding the central issue. i think you know that, so get off the "professional insult" baloney or get over it.
> > > There is no need to bring up the periodicity issue. The DFT stands on > > > its own as a linear algebraic transform. > > > > *merely* saying that "The DFT stands on its own as a linear algebraic > > transform" is insufficient to support saying "There is no need to > > bring up the periodicity issue." it is a straw man. a red herring. > > a distraction. non-sequitur. > > Is it, or is it not, true, that the DFT stands on its own as a > linear-algebraic transform"?
whatever you mean by "stands on it own". it *is* a linear algebraic transform, if by that you mean it's a linear operator in a hilbert space.
> If the answer is "yes" then I can use it not caring at all about the > periodicity issue,
wrong. if you use the shifting or convolution operators, you need to care about the periodic extension (one way to "care" about it is to zero-pad sufficiently) or you will get incorrect results.
> whether or not it exists. That's a fact.
so you say. go ahead and bring up *exactly* why the MDCT (which i have never used but i know how the DCT can be related to the DFT and it changes nothing regarding the inherent periodicity) or QMF filters. BUT BE SPECIFIC and mathmatically rigorous. just tossing out buzz words like "QMF" of "MDCT" as proof will not suffice. r b-j
Reply by Mark Ovchain May 17, 20042004-05-17
Randy Yates <yates@ieee.org> wrote in message news:<n047erqq.fsf@ieee.org>...
> mark_ovchain@yahoo.com (Mark Ovchain) writes:
> > Invalid != unnecessary. > > > > I don't think anyone has said that the historical interpretation is > > wrong. Did someone? Did I miss that? > > Yup.
Err. Um, whatever. Wasn't me that said that. How can it be invalid, it was, after all, the original way that the particular set of basis vectors was discovered??? It's the historical version, but no, it's not invalid.
Reply by Randy Yates May 16, 20042004-05-16
mark_ovchain@yahoo.com (Mark Ovchain) writes:

> rbj@surfglobal.net (robert bristow-johnson) wrote in message news:<4cbb922e.0405142205.3def6089@posting.google.com>... >> i *did* mean to imply that "merely" referring to >> the linear mapping of the DFT was not sufficient to justify that it >> has no inherent periodicity and the context that i was reacting to was >> here: > > Who has said that the periodicity is INVALID? > > Invalid != unnecessary. > > I don't think anyone has said that the historical interpretation is > wrong. Did someone? Did I miss that?
Yup. -- % Randy Yates % "I met someone who looks alot like you, %% Fuquay-Varina, NC % she does the things you do, %%% 919-577-9882 % but she is an IBM." %%%% <yates@ieee.org> % 'Yours Truly, 2095', *Time*, ELO http://home.earthlink.net/~yatescr
Reply by Mark Ovchain May 16, 20042004-05-16
rbj@surfglobal.net (robert bristow-johnson) wrote in message news:<4cbb922e.0405142205.3def6089@posting.google.com>...
> i *did* mean to imply that "merely" referring to > the linear mapping of the DFT was not sufficient to justify that it > has no inherent periodicity and the context that i was reacting to was > here:
Who has said that the periodicity is INVALID? Invalid != unnecessary. I don't think anyone has said that the historical interpretation is wrong. Did someone? Did I miss that? It's just not the ONLY one, and it is an unnecessarily limiting interpretation.
> back to the current post:
> > The historical meaning of the DFT is quite clear. > > fine. but i never made any appeal to the historical. my only issues > here are conceptual (or foundational) and practical.
You have not shown why there is any need whatsoever to appeal to the periodic nature of the DFT.
> again, repeating a fallacy doesn't sell it here. dunno why you say i > am putting words in your mouth. these words (above) are plenty to > take issue with.
Please show where insisting on infinite periodicity is NECESSARY in a DFT. You have never done that. Taken as a linear-algebraic transform there is no, zero need to insist on any thing outside the time limits of the DFT. The fact that, yes, you CAN have another interpretation is sometimes useful, I agree, but you have done nothing to show that it's necessary. You can't, because it's not. You demand I prove the negative, and you refer to what I am saying as a fallacy. But you offer no positive proof that what you insist is necessary is necessary. The obligation to your extraordinary claim is entirely upon you. Since I can show that the DFT is orthonormal, and since you have stipulated that, I have fully, absolutely, and incontrovertibly proven my point already, and you have so stipulated. But yet you claim that when I say that, I'm repeating a "fallacy". Your position is inconsistant, and your use of the word "fallacy" a professional insult of the worst kind, yet you have stipulated the truth of my position already.
> > There is no need to bring up the periodicity issue. The DFT stands on > > its own as a linear algebraic transform. > > *merely* saying that "The DFT stands on its own as a linear algebraic > transform" is insufficient to support saying "There is no need to > bring up the periodicity issue." it is a straw man. a red herring. > a distraction. non-sequitur.
Is it, or is it not, true, that the DFT stands on its own as a linear-algebraic transform"? If the answer is "yes" then I can use it not caring at all about the periodicity issue, whether or not it exists. That's a fact. There is no insufficiency whatsoever. I can use the theorems that apply, etc, without ever considering the fact that there is a periodicity involved. That is true, you know. I may understand something more, sometimes, by understanding the periodic implications, certainly, I haven't ever said anything else.
> do you now understand why i used the word "merely"? i didn't just > pull it out of the air.
Because there is no "mere" to showing that something is an orthonormal transform. Once one shows that, it brings up a whole host of very desirable properties that one can depend on, etc.
> i *did* qualify it with "apparently". you appear to deny that the DFT > inherently periodically extends the data given it when you say it's > "NOT NECESSARY" or "NO NEED".
I do nothing of the sort. That is a pure straw man, based on something I simply can't fathom. I am saying that once we know it's an orthonormal transform, we know a lot of important things. The fact it diagonalizes real signals very well is also very important. None of that relates to its periodic interpretation at all.
> the fact that it is valid remains even in contexts where you insist > that it's "NOT NECESSARY".
Of course. Many valid things are not necessary. What's the deal?
> repeating a fallacy does not make it less fallacious.
And repeating a false professional accusation does not make it any less objectionable, either.
> so, i'm saying that you can't get away from it (this periodic > extension of data inherent to the DFT) even if you try.
Why must I care about that? I need not, and in fact, when I cease to worry about that, now I can much more easily formulate an OBT, or MLT, in fact, than I can if I stick to this one-block-periodicity you keep pointing out. It's just one example out of an infinite set of cases... Repeat over one block, 2 blocks, n blocks, when formulated correctly, all the same.
> once aliasing (be it frequency domain or time domain) has occurred, > you do not know if the alias was from wrap-around or a periodic copy > or if the "alias" was there in the first place. in any case i think > this is non-sequitur.
That would appear to argue that a QMF does not work. Does it, or does it not, work? Does, or does not, an MDCT work? You just suggested that, as well.
> you don't have to participate which makes me curious why you would if > there was no point.
Because I think, and strongly continue to think, given your obvious knowledge and your continued obtuseness, that the periodic interpretation "sticks" you into a set of unnecessary constraints.
> The DFT maps one infinite and periodic discrete "time" sequence > of period N, of which one only specifies N contiguous samples > of it, to another infinite and periodic discrete "frequency" > sequence of the same period and the iDFT maps it back. The DFT > "understands" or "assumes" (if anthropomorphism is allowed) the > N samples supplied to it to be one period of this periodic > discrete sequence and likewise for the iDFT. In this manner, > the DFT (and iDFT) periodically extends the data supplied to it > which has salience where those N samples were extracted from a > longer, possibly non-periodic sequence. One may know those N > samples x[n] to not be from a periodic context, but when they > go into the DFT, that fact is lost to it, its output X[k], and > all further operations done on it. All further operations that > cause shifting to either x[n] or X[k] (including convolution) > *must* *necessarily* be considered to be operating on periodic > extensions of the original x[n] or X[k] to get correct results. > The DFT and the DFS are, in any meaningful way, one and the same.
And, I repeat, you're limiting your own understanding by including unnecessary constraints in your definition. How about something that is periodic over TWO analysis blocks. What does that get you? Etc, etc.
> > The DFT is different, because of the environment it lives in. It need > > not have an infinite-energy formulation. It need not worry at all > > about its validity, unless the input data contains infinities, unlike > > a Fourier Integral. It has a different set of properties, a set of > > properties that extend beyond the meaning of the Fourier Integral.
How dare you insist that a basic difference in properties is a non-sequiter? Your sheer arrogance in denying these basic, mathematically obvious FACTS are germane is simply astonishing.
> let's see if it's necessary if linearity is applied: > > DFT{ x[n] + y[n] } = X[k] + Y[k] > > DFT{ A*x[n] } = A*X[k] > > ya know, i guess in this case, it ain't necessary.
Yes?
> likewise, in this case, what does one do with x[n-m] when m>n ? we > gotta do something to x[n] to make it work for those indices, which > is necessarily an extension, and the only correct extension is the > periodic extension, x[n+N] = x[n].
Why do you ignore the idea of aliasing here, only to demonstrate it? Your very obtuseness shows, I think, the harmful nature of the too-limited interpretation.
Reply by Mark Ovchain May 16, 20042004-05-16
Randy Yates <yates@ieee.org> wrote in message news:<ekplzqj6.fsf@ieee.org>...
> mark_ovchain@yahoo.com (Mark Ovchain) writes: > > No periodicity is required. > > Yes, it necessarily is.
You were shouting at me for "mere controversion". Physician, heal thyself!
> > Narrowband noise is not, for instance, > > periodic, it is quasi-periodic.
> It also does not have a frequency response that is discrete, thus > it is not representable by a DFT output. Of course you have gone > from deterministic signals to stochastic signals, too, so this > example is not a good one.
A time-limted section of narrow-band noise is perfectly well represented by its DFT. Nothing outside that scope of time need be involved. One can do this easily, and show this easily, so... What do you mean?
> > I have to say I'm not so clear on what you think I'm "admitting". > > Frequency is frequency. You can state a frequency inside of a window, > > something that is time limited and not even sampled. I simply don't > > see what you're talking about in a very real way, many non-periodic > > things can have distinct frequency spectra, etc...
> Really? Name one.
Hm, do you mean distinct or discrete (as in single-valued)? I'd think that when we've established that the DFT is fully valid as solely a linear-algebraic transform, and we have, the "distinct" is, well, perfectly proven, yes? There are, of course, also chaotic attractors with quasi-periods, etc. I presume I don't have to point them out, do I? I mean, delta-sigma idle tones are rather well known.